Changelog

New Query Tool and Vapi Voice Provider, Updates to Language Support and Error Handling

1. New Query Tool Feature and Knowledge Base Integration

• The API now supports a new query tool that allows assistants to search through knowledge bases. Add this tool to any assistant model by configuring it at assistant.model.tools[type=query] path.
• You can now link knowledge bases to query tools, providing structured information sources for assistants to access. Define knowledge bases with a name, model, provider, description, and associated file IDs.

1
{
2
  "type": "query",
3
  "async": false,
4
  "server": {
5
    "url": "https://api.example.com/query-handler"
6
  },
7
  "function": {
8
    "name": "query_knowledge",
9
    "description": "Query knowledge bases for information",
10
    "parameters": {
11
      "type": "object",
12
      "properties": {
13
        "query": {
14
          "type": "string",
15
          "description": "The query to search for"
16
        }
17
      },
18
      "required": ["query"]
19
    }
20
  },
21
  "knowledgeBases": [
22
    {
23
      "name": "Product Documentation",
24
      "model": "gemini-1.5-flash",
25
      "provider": "google",
26
      "description": "Contains all product manuals",
27
      "fileIds": ["file-123", "file-456"]
28
    }
29
  ]
30
}

2. New Voice Provider Support

A new voice provider “vapi” has been added with support for a voice called “Jordan” in FallbackVapiVoice. Configure it in our assistant fallback plans at assistant.voice.fallbackPlan.voices.

3. Language Support Updates

Myanmar language (“my”) has been added to supported languages, while “jp” and “mymr” codes have been removed. Use “ja” for Japanese language and “my” for Myanmar. Reference GladiaTranscriber for more language codes.

4. Error Handling Improvements

Added new error code pipeline-error-11labs-transcriber-failed for ServerMessageStatusUpdate.endedReason and ServerMessageEndOfCallReport.endedReason. Also added an explicit failed status for test suite runs in TestSuiteRun. These additions provide more detailed error reporting.

5. Azure OpenAI Model Update

The model gpt-4o-2024-08-06-ptu has been removed from Azure OpenAI credential schemas. Update any credential configurations that were using this model.