New Universal-3.6 Pro Realtime is now available Learn more
LLM Gateway

Browse LLM Gateway models

Compare context, pricing, and capabilities across every model the Gateway serves, and run any of them with the same API key as your Speech-to-Text.

Providers0
Regions0
Features0
New models first

Showing 50 of 50 models

LLM Gateway models with context window, input, output and cached token rates per 1 million tokens, capabilities, serving providers and regions.
Capabilities Providers Regions
anthropic/claude-opus-5 New
200K $5.00/M $25.00/M
Read:$0.50/M Write:$6.25/M
Tools Streaming AWS Bedrock USGlobal
google/gemini-3.8-flash New
1M $0.75/M $3.75/M
Read:$0.07/M Write:—
JSON Tools Streaming Vertex USEUGlobal
openai/gpt-5.6-sol New
270K $4.00/M $20.00/M
Read:$0.40/M Write:$5.00/M
JSON Tools Streaming Open AI USGlobal
google/gemma-4-31b New
256K $0.14/M $0.40/M
Read:— Write:—
JSON Tools Streaming AWS Bedrock US
google/gemini-3.7-flash New
1M $0.75/M $3.75/M
Read:$0.07/M Write:—
JSON Tools Streaming Vertex USEUGlobal
nvidia/nemotron-lightning-3p5-30b-a3b
262K $0.05/M $0.20/M
Read:$0.01/M Write:—
Tools JSON Streaming Fireworks US
openai/gpt-5-nano
400K $0.05/M $0.40/M
Read:$0.005/M Write:—
JSON Tools Streaming Open AI US
nvidia/nemotron-3-nano-30b-a3b
256K $0.06/M $0.24/M
Read:— Write:—
Tools JSON Streaming AWS Bedrock USEU
nvidia/nemotron-nano-9b-v2
128K $0.06/M $0.23/M
Read:— Write:—
Tools JSON Streaming AWS Bedrock USEU
openai/gpt-oss-20b
131K $0.07/M $0.30/M
Read:— Write:—
Tools AWS Bedrock US
assemblyai/qwen3.5-4b-32k-fast
33K $0.10/M $0.50/M
Read:— Write:—
Streaming AssemblyAI USEU
google/gemini-2.5-flash-lite
1M $0.10/M $0.40/M
Read:$0.01/M Write:—
JSON Tools Streaming Vertex USEUGlobal
openai/gpt-6-luna
922K $0.10/M $0.50/M
Read:$0.01/M Write:$0.13/M
Tools Streaming JSON AWS BedrockOpen AI USGlobal
alibaba/qwen3-32B
200K $0.15/M $0.60/M
Read:— Write:—
Tools JSON Streaming AWS Bedrock US
alibaba/qwen3-next-80b-a3b
200K $0.15/M $1.20/M
Read:— Write:—
Tools JSON Streaming AWS Bedrock USEU
nvidia/nemotron-3-super-120b-a12b
256K $0.15/M $0.65/M
Read:— Write:—
Tools JSON Streaming AWS Bedrock USEU
openai/gpt-oss-120b
131K $0.15/M $0.60/M
Read:— Write:—
JSON Tools AWS Bedrock US
zai/glm-5.3-flash
1M $0.15/M $0.50/M
Read:$0.03/M Write:—
Tools JSON Streaming Digital OceanFireworks US
openai/gpt-5.6-luna
270K $0.20/M $1.20/M
Read:$0.02/M Write:$0.25/M
JSON Tools Streaming Open AI USEUGlobal
google/gemini-3.1-flash-lite
1M $0.25/M $1.50/M
Read:$0.03/M Write:—
JSON Tools Streaming Vertex USEUGlobal
openai/gpt-5-mini
400K $0.25/M $2.00/M
Read:$0.03/M Write:—
JSON Tools Streaming Open AI US
deepseek/deepseek-v4.1-flash
1M $0.30/M $1.20/M
Read:$0.006/M Write:—
Tools JSON Streaming Digital OceanFireworks US
google/gemini-2.5-flash
1M $0.30/M $2.50/M
Read:$0.03/M Write:—
JSON Tools Streaming Vertex USEUGlobal
google/gemini-3.5-flash-lite
1M $0.30/M $2.50/M
Read:$0.03/M Write:—
JSON Tools Streaming Vertex USGlobal
minimax/minimax-m3
512K $0.30/M $1.20/M
Read:$0.06/M Write:—
Tools JSON Streaming Fireworks US
zai/glm-5.3
1M $0.95/M $3.40/M
Read:$0.20/M Write:—
Tools JSON Streaming Digital OceanFireworks US
anthropic/claude-haiku-4-5-20251001
200K $1.00/M $5.00/M
Read:$0.10/M Write:$1.25/M
Tools JSON Streaming AWS Bedrock USEUGlobal
google/gemini-2.5-pro
200K $1.25/M $10.00/M
Read:$0.13/M Write:—
JSON Tools Streaming Vertex USEUGlobal
google/gemini-3.5-flash
1M $1.25/M $9.00/M
Read:$0.13/M Write:—
JSON Tools Streaming Vertex USGlobal
openai/gpt-5
400K $1.25/M $10.00/M
Read:$0.13/M Write:—
Tools Streaming JSON Open AI US
openai/gpt-5.1
400K $1.25/M $10.00/M
Read:$0.13/M Write:—
JSON Tools Streaming Open AI US
google/gemini-3.6-flash
1M $1.50/M $7.50/M
Read:$0.15/M Write:—
JSON Tools Streaming Vertex USEUGlobal
openai/gpt-5.2
400K $1.75/M $14.00/M
Read:$0.17/M Write:—
JSON Tools Streaming Open AI US
anthropic/claude-sonnet-5-5
1M $2.00/M $10.00/M
Read:$0.20/M Write:$2.50/M
Tools Streaming AWS Bedrock USGlobal
openai/gpt-4.1
1M $2.00/M $8.00/M
Read:$0.50/M Write:—
Tools Streaming Open AI US
openai/gpt-5.6-terra
270K $2.00/M $12.00/M
Read:$0.20/M Write:$2.50/M
JSON Tools Streaming Open AI USGlobal
openai/gpt-6-sol
922K $2.00/M $10.00/M
Read:$0.20/M Write:$2.50/M
Tools Streaming JSON AWS BedrockOpen AI USGlobal
openai/gpt-6.1-sol
922K $2.00/M $10.00/M
Read:$0.10/M Write:$2.50/M
Streaming JSON AWS BedrockOpen AI US
xai/grok-4.7
500K $2.00/M $6.00/M
Read:$0.50/M Write:—
Tools Streaming JSON AWS Bedrock USGlobal
anthropic/claude-sonnet-4-5-20250929
200K $3.00/M $15.00/M
Read:$0.30/M Write:$3.75/M
Tools JSON Streaming AWS Bedrock USEUGlobal
anthropic/claude-sonnet-4-6
200K $3.00/M $15.00/M
Read:$0.30/M Write:$3.75/M
Tools JSON Streaming AWS Bedrock USEUGlobal
anthropic/claude-sonnet-5
200K $3.00/M $15.00/M
Read:$0.30/M Write:$3.75/M
Tools Streaming AWS Bedrock USGlobal
moonshot-ai/kimi-k3
1M $3.00/M $15.00/M
Read:$0.30/M Write:$3.75/M
Tools JSON Streaming AWS BedrockFireworks USGlobal
anthropic/claude-opus-5-5
1M $4.00/M $20.00/M
Read:$0.20/M Write:$5.00/M
Tools Streaming AWS Bedrock USEUGlobal
anthropic/claude-opus-4-5-20251101
200K $5.00/M $25.00/M
Read:$0.50/M Write:$6.25/M
Tools JSON Streaming AWS Bedrock USGlobal
anthropic/claude-opus-4-6
200K $5.00/M $25.00/M
Read:$0.50/M Write:$6.25/M
Tools JSON Streaming AWS Bedrock USGlobal
anthropic/claude-opus-4-7
1M $5.00/M $25.00/M
Read:$0.50/M Write:$6.25/M
Tools Streaming AWS Bedrock USGlobal
anthropic/claude-opus-4-8
1M $5.00/M $25.00/M
Read:$0.50/M Write:$6.25/M
Tools Streaming AWS Bedrock US
openai/gpt-5.5
272K $5.00/M $30.00/M
Read:$0.50/M Write:—
JSON Tools Streaming Open AI USGlobal
openai/gpt-6-astra
270K $10.00/M $50.00/M
Read:$1.00/M Write:$12.50/M
Tools Streaming JSON Open AIAWS Bedrock US

Models are listed as maker/model. The part after the slash is the exact model value to pass in a request. The Gateway does not accept the maker prefix.

Rates are for global routing. In-region US and EU endpoints are 10% higher, passed through from provider pricing with no AssemblyAI upcharge. See pricing for the full rate card.

Cache read is the rate for tokens served from the prompt cache; cache write is the rate to store them. An em dash means the model has no cache tier. See prompt caching.

Providers are where a request is served from — Claude models run on Bedrock, Gemini on Vertex, and Qwen3.5 4B Fast on AssemblyAI's own GPUs. This table is generated from the Gateway's own Models endpoint, so it always matches what the API accepts. The docs roster adds quality scores and measured latency.