ResourcesIntegrationsLarge language models

Anyscale

Connect Anyscale and configure a model available to your account.

What is Anyscale

Anyscale provides OpenAI-compatible endpoints for serving language models. Use the Anyscale integration when you want your Vapi assistant to use a model available through your Anyscale account.

Connect Anyscale

Before using Anyscale, connect your account on the Integrations page.

Language model

Set model.provider to anyscale. Set model.model to the exact model ID available through your connected Anyscale account.

$curl -X PATCH "https://api.vapi.ai/assistant/ASSISTANT_ID" \
>  -H "Authorization: Bearer $VAPI_API_KEY" \
>  -H "Content-Type: application/json" \
>  -d '{
>    "model": {
>      "provider": "anyscale",
>      "model": "YOUR_ANYSCALE_MODEL_ID"
>    }
>  }'

For additional configuration options, review the AnyscaleModel fields in the Create Assistant API reference.

Anyscale model serving

Learn how Anyscale serves language models through OpenAI-compatible endpoints.

Language models

Compare every language model provider Vapi supports.