New Universal-3.5 Pro is here. Learn more: Async Realtime
LLM Gateway

Browse LLM Gateway models

Compare capabilities, context, and pricing from leading providers so you can run any LLM-based task with the same API key as your Speech-to-Text.

Showing 31 of 31 models

LLM Gateway models with provider, context window, capabilities, and input, output, and cached-input token rates per 1 million tokens.
Model Provider Context tokens Input per 1M tokens Output per 1M tokens Cached in per 1M tokens
GPT-5 Nano gpt-5-nano JSON · Tools · Streaming US OpenAI 400K $0.05 $0.40 $0.005
GPT OSS 20B gpt-oss-20b Tools US OpenAI 131K $0.07 $0.30
Gemini 2.5 Flash Lite gemini-2.5-flash-lite JSON · Tools · Streaming US · EU · Global Google 1M $0.10 $0.40 $0.01
Qwen3.5 4B Fast qwen3.5-4b-32k-fast Streaming US · EU Qwen 33K $0.10 $0.50
gemma-4-31b gemma-4-31b JSON · Tools · Streaming US Google 256K $0.14 $0.40
GPT OSS 120B gpt-oss-120b JSON · Tools US OpenAI 131K $0.15 $0.60
Qwen3 32B qwen3-32B Tools · JSON · Streaming US Qwen 200K $0.15 $0.60
Qwen3 Next 80B A3B qwen3-next-80b-a3b Tools · JSON · Streaming US Qwen 200K $0.15 $1.20
Gemini 3.1 Flash Lite gemini-3.1-flash-lite JSON · Tools · Streaming US · Global Retires 2027-05-07 Google 1M $0.25 $1.50 $0.03
GPT-5 mini gpt-5-mini JSON · Tools · Streaming US OpenAI 400K $0.25 $2.00 $0.03
Gemini 2.5 Flash gemini-2.5-flash JSON · Tools · Streaming US · EU · Global Google 1M $0.30 $2.50 $0.03
Gemini 3.5 Flash Lite gemini-3.5-flash-lite JSON · Tools · Streaming US · Global Google 1M $0.30 $2.50 $0.03
Gemini 3.7 Flash gemini-3.7-flash JSON · Tools · Streaming US · EU · Global Google 1M $0.75 $3.75 $0.07
GPT-5.6 Luna gpt-5.6-luna JSON · Tools · Streaming US · Global OpenAI 270K $1.00 $6.00 $0.10
Haiku 4.5 claude-haiku-4-5-20251001 Tools · JSON · Streaming US · EU · Global Anthropic 200K $1.00 $5.00 $0.10
Gemini 2.5 Pro gemini-2.5-pro JSON · Tools · Streaming US · EU · Global Google 200K $1.25 $10.00 $0.13
Gemini 3.5 Flash gemini-3.5-flash JSON · Tools · Streaming US · Global Google 1M $1.25 $9.00 $0.13
GPT-5 gpt-5 Tools · Streaming · JSON US OpenAI 400K $1.25 $10.00 $0.13
GPT-5.1 gpt-5.1 JSON · Tools · Streaming US OpenAI 400K $1.25 $10.00 $0.13
Gemini 3.6 Flash gemini-3.6-flash JSON · Tools · Streaming US · EU · Global Google 1M $1.50 $7.50 $0.15
GPT-5.2 gpt-5.2 JSON · Tools · Streaming US OpenAI 400K $1.75 $14.00 $0.17
GPT-4.1 gpt-4.1 Tools · Streaming US OpenAI 1M $2.00 $8.00 $0.50
GPT-5.6 Terra gpt-5.6-terra JSON · Tools · Streaming US · Global OpenAI 270K $2.50 $15.00 $0.25
Sonnet 4.5 claude-sonnet-4-5-20250929 Tools · JSON · Streaming US · EU · Global Anthropic 200K $3.00 $15.00 $0.30
Sonnet 4.6 claude-sonnet-4-6 Tools · JSON · Streaming US · EU · Global Anthropic 200K $3.00 $15.00 $0.30
Sonnet 5 claude-sonnet-5 Tools · Streaming US · Global Anthropic 200K $3.00 $15.00 $0.30
GPT-5.5 gpt-5.5 JSON · Tools · Streaming US · Global OpenAI 272K $5.00 $30.00 $0.50
Opus 4.5 claude-opus-4-5-20251101 Tools · JSON · Streaming US · Global Anthropic 200K $5.00 $25.00 $0.50
Opus 4.6 claude-opus-4-6 Tools · JSON · Streaming US · Global Anthropic 200K $5.00 $25.00 $0.50
Opus 4.7 claude-opus-4-7 Tools · Streaming US · Global Anthropic 1M $5.00 $25.00 $0.50
Opus 4.8 claude-opus-4-8 Tools · Streaming US Anthropic 1M $5.00 $25.00 $0.50

Rates are for global routing. In-region US and EU endpoints are 10% higher, passed through from provider pricing with no AssemblyAI upcharge. See pricing for the full rate card.

Cached input is the rate for tokens served from the prompt cache. An em dash means the model has no cache tier. See prompt caching.

This table is generated from the Gateway's own Models endpoint, so it always matches what the API accepts. The docs roster adds quality scores and measured latency.