Modal Shared API
Modal's OpenAI-compatible, token-billed inference endpoint, launched with day-zero Kimi K3 support.
Overview
Modal launched a Shared API on July 29, 2026 -- its first inference product billed by token rather than by GPU-second, a departure from its per-second compute billing model. It shipped with day-zero support (with vLLM and Moonshot) for Kimi K3, a 2.8T-parameter multimodal model with a 1M-token context window, serving it at 460 tokens/sec on release day. Kimi K3 is available via the Shared API (token pricing, Team/Enterprise) or as a dedicated Auto Endpoint on any plan.
This is a sourced directory entry. Features and capabilities are reported in the linked sources; this entry does not document independent Aymorphic testing.
Key features
- OpenAI-compatible endpoint
- Token-based billing (new for Modal)
- Day-zero Kimi K3 support with vLLM/Moonshot
- Dedicated Auto Endpoint option for any plan
Use cases
- Serving open multimodal models without managing GPU infrastructure
- Cost-predictable token billing vs GPU-second billing
- Fast access to newly released open-weight models
Pricing
Kimi K3: $3/M prompt tokens, $0.30/M cached prompt tokens, $15/M completion/reasoning tokens on Shared API (Team/Enterprise); Auto Endpoint available on any plan.
Pricing reflects the source record and may change. Confirm current terms with the provider.
Dates and sources
- Released
- 29 Jul 2026
- Record updated
- 23 Sept 2026
- Record last checked
- 23 Sept 2026