What is the best speech-to-text API for multiple languages? expand_more
AssemblyAI supports 32 languages at flagship accuracy on AssemblyAI-STT-3.7-Realtime-Agent, with native mid-sentence code-switching in a single stream. For live transcripts nobody has to answer, AssemblyAI-STT-3.7-Realtime covers the same 32 languages at $0.30/hr. Premium accuracy plus a cost-optimized option on one account is what sets it apart for multilingual voice agents.
How do I build a multilingual voice agent? expand_more
Start from the LiveKit or Pipecat reference implementation, which wires AssemblyAI-STT-3.7-Realtime-Agent, LLM Gateway, and the Text-to-Speech API together on one API key and one bill. AssemblyAI-STT-3.7-Realtime-Agent handles code-switching across 32 languages with no primary language to declare, LLM Gateway routes the transcript to the LLM of your choice (or bring your own), and your orchestrator handles tool calls and reconnects. The Text-to-Speech API covers English, Spanish, French, German, Italian, and Portuguese; for other languages, pair AssemblyAI-STT-3.7-Realtime-Agent with another TTS provider.
Which languages does AssemblyAI support for voice agents? expand_more
32 at flagship accuracy on AssemblyAI-STT-3.7-Realtime-Agent: Afrikaans, Arabic, Cantonese, Catalan, Danish, Dutch, English, Estonian, Finnish, French, Galician, German, Hebrew, Hindi, Italian, Japanese, Korean, Mandarin, Marathi, Norwegian (Bokmål and Nynorsk), Persian, Portuguese, Romanian, Russian, Spanish, Swedish, Turkish, Urdu, Vietnamese, Xhosa, and Zulu — with native code-switching. For live transcripts nobody has to answer, AssemblyAI-STT-3.7-Realtime covers the same 32 languages in one stream at $0.30/hr. The Text-to-Speech API speaks English, Spanish, French, German, Italian, and Portuguese. For non-real-time use like post-call analytics, pre-recorded transcription adds automatic language detection across 99+ languages.
Can AssemblyAI handle code-switching between languages? expand_more
Yes — natively. AssemblyAI-STT-3.7-Realtime-Agent recognizes and preserves language switches mid-utterance (Hinglish, Spanglish, and more) in a single stream, without requiring you to declare a primary language. Keyterms prompting handles the proper nouns and technical terms that span languages.
How does language detection work for a multilingual voice agent? expand_more
For live streaming you don't declare a language — AssemblyAI-STT-3.7-Realtime-Agent handles code-switching across its 32 languages automatically, and you select the model with the speech_model parameter (for example, assemblyai-stt-3-7-realtime-agent, or assemblyai-stt-3-7-realtime for the cost-optimized tier). For pre-recorded audio, automatic language detection identifies the dominant language and routes to the best model across 99+ languages.
How much does multilingual transcription cost? expand_more
There's no language surcharge on the flagship models. AssemblyAI-STT-3.7-Realtime-Agent is $0.45/hr across all 32 languages, with unlimited concurrent streams and no concurrency fees. The Text-to-Speech API is $15 per 1M characters, billed on input characters, at the same price in the US or EU and with no spend commitment to unlock concurrency. AssemblyAI-STT-3.7-Realtime is the lower-cost option at $0.30/hr for live transcripts nobody has to answer, across the same 32 languages.