AssemblyAI

Use AssemblyAI Universal-Streaming for real-time speech-to-text in Vapi.

Universal-Streaming

Universal-Streaming is AssemblyAI’s purpose-built speech-to-text model that delivers ultra-fast, immutable transcripts in ~300ms with intelligent endpointing and superior accuracy for voice agents. It eliminates common pain points like misheard account numbers, awkward pauses, and premature cutoffs, enabling more natural and successful voice interactions.

Speech-to-text

Set transcriber.provider to assembly-ai. AssemblyAI’s Universal-Streaming model is selected automatically, so no model field is required.

$curl -X PATCH "https://api.vapi.ai/assistant/ASSISTANT_ID" \
> -H "Authorization: Bearer $VAPI_API_KEY" \
> -H "Content-Type: application/json" \
> -d '{
> "transcriber": {
> "provider": "assembly-ai",
> "language": "en"
> }
> }'

For additional API configuration options, review the AssemblyAITranscriber fields in the Create Assistant API reference.

Configure in the dashboard

This guide details how to setup AssemblyAI as a transcriber for your assistant.

1

Head to the “Assistants” tab in your Vapi dashboard.

Click on your assistant and then the “Transcriber” tab.

Select “assembly-ai” on the Provider dropdown.

Supported languages

Vapi supports AssemblyAI’s English and multilingual Universal-Streaming modes.

ModeSpeech modelLanguage valueSupported languages
Englishuniversal-streaming-englishenEnglish
Multilingualuniversal-streaming-multilingualmultiEnglish, French, German, Italian, Portuguese, and Spanish

Keyterms prompting is not supported with the multilingual model.