New Universal-3.5 Pro is here. Learn more: Async Realtime
LLM Gateway

The LLM layer for Voice AI

One OpenAI-compatible API for every frontier model—built to run right alongside your speech-to-text.

  • Route 25+ frontier models from OpenAI, Anthropic, Google, and more
  • Native speech-to-text in the same pipeline—no second vendor, no extra hop
  • 0% markup, automatic fallbacks, EU data residency, and zero data retention

Built for Voice AI

Your LLM calls run in the same pipeline as your transcription. Apply any model to your audio with no second vendor and no extra network hop.

0% markup

Pay provider token rates with no gateway fee, no credit surcharge, and no minimum commitment. The price you see is the price you pay.

Reliable by default

Configure per-request fallbacks across providers. When a model errors or rate-limits, your call transparently retries the next one—no code changes.

Metaview
Ashby
Cluely
Genio
Siro

36%

improvement in close rate

See case study
LiveKit
Earmark
Commure
Dovetail
Fireflies

“The new Universal-3.5 Pro speech model from AssemblyAI is best so far in terms of accuracy, latency, and language switching.”

Retell
CallRail
Apollo.io
ClickUp
Calabrio

80%

increase in customer satisfaction

HeyGen
Granola
Siro
JotPsych
Granola

“Assembly has saved us countless hours managing models, and provided exceptional accuracy.”

Metaview
Ashby
Cluely
Genio
Siro

36%

improvement in close rate

See case study
LiveKit
Earmark
Commure
Dovetail
Fireflies

“The new Universal-3.5 Pro speech model from AssemblyAI is best so far in terms of accuracy, latency, and language switching.”

Retell
CallRail
Apollo.io
ClickUp
Calabrio

80%

increase in customer satisfaction

HeyGen
Granola
Siro
JotPsych
Granola

“Assembly has saved us countless hours managing models, and provided exceptional accuracy.”

Live demo

Pick a model. Take action on your audio.

Prompt

What is runner's knee?

claude-opus-4-7 412 ms · 47 tokens

Based on the transcript, runner's knee is a condition characterized by pain behind or around the kneecap. It is caused by overuse, muscle imbalance and inadequate stretching. Symptoms include pain under or around the kneecap and pain when walking.

Everything you get with the LLM Gateway

25+ frontier models

GPT, Claude, Gemini, Qwen, Mistral, and more behind one endpoint. New models are added the day they launch.

OpenAI-compatible

Drop into any OpenAI SDK or HTTP client. Change a base URL and a model string, and the rest of your code keeps working.

Function calls & typed JSON

Tool calls and schema-enforced JSON out of the box, so model responses drop straight into your app.

Prompt caching

Cached prompts cost less and respond faster on every turn of a conversation.

EU data residency

EU-resident infrastructure, on by default for traffic originating in the EU, for GDPR-sensitive workloads.

Zero data retention

Opt into zero data retention per request or project-wide, so prompts and responses are never stored.

BAA available

Sign a Business Associate Addendum for applications that process PHI, backed by SOC 2 Type 2, ISO 27001, PCI DSS, and GDPR.

One key, one bill

Run your entire voice-to-intelligence pipeline—speech-to-text and LLMs—on a single API key and invoice.

Built deeper than the alternatives

Model
AssemblyAI LLM Gateway
OpenRouter
llmgateway.io
Bridges to
25+ models, every major provider
400+ models
200+ models
Speech-to-text integration
Native—no extra hop
Routes to third-party ASR
Automatic fallbacks
Configurable per-model
Auto-routing + retries
Pricing
0% markup
~5.5% credit fee
5% managed fee
Same-day model releases
EU data residency
Default-on for EU traffic
Enterprise-only
Regional pins only
Zero data retention
Opt-in, per request
Via ZDR-provider routing
OpenAI SDK compatible
Quickstart

Your first Gateway call, minutes after you sign up

Create a free account, point your OpenAI SDK at the Gateway, and start calling any frontier model. Already using AssemblyAI speech-to-text? It's the same API key.

Start building free

No credit card required

Frequently asked questions