Configure an AI tester
Configure the scenario and personality together to control an AI tester. The scenario defines what the tester should accomplish, while the personality defines how it behaves and communicates.
Scenario and personality roles
Each simulation pairs one scenario with one personality. Keep their responsibilities separate so you can reuse the same customer behavior across different test cases:
Write the scenario as instructions for the AI tester, not as the expected outcome. Define pass or fail conditions separately under Success criteria.
Dashboard and API settings
The available settings depend on whether you configure the AI tester in the Dashboard or through the API:
In the Dashboard, Scenario settings are on the Scenario tab, and the Behavior, Model, Transcriber, and Voice settings are on the Personality tab.
Chat simulations ignore transcriber and voice settings. Behavior, model, and turn-taking settings still apply.
Configure the AI tester
Dashboard
cURL
Open the simulation
Open Simulations, select Suites, and create or edit a suite. Select the simulation you want to configure.
Define the scenario
On the Scenario tab, enter a scenario name and intent (the scenario’s instructions field in the API). Include the AI tester’s goal, information it can provide, actions it should take, and when it should end the conversation.
Keep behavioral traits such as tone, patience, and interruption style out of the scenario. Configure those traits in the personality so you can reuse them with other scenarios.
Set the behavior
Open the Personality tab. Enter the instructions that define how the AI tester should act. Under Who starts first?, select AI tester or Assistant or squad.
Configure the model
Expand Advanced settings. Under Model, select the provider and model that control how the AI tester reasons.
Configure voice settings
For a voice simulation, configure these optional settings by expanding Advanced settings:
- Under Transcriber, select the speech-to-text provider, language, and model.
- Under Voice, select the provider and voice, or enter a custom voice ID.
Set the AI tester’s transcriber to match the language used by the assistant or squad you’re testing, or use a transcriber that supports automatic language detection. Otherwise, the AI tester may not understand the replies and may repeat the same questions. Also select a model and voice that support the same language.
Editing a built-in (Default) personality in the Dashboard saves it as a new personality you own. The built-in personality remains unchanged.
Background sound
Background sound is an audio file that the AI tester plays throughout a voice simulation, mixed with its speech. Use it to test how the assistant or squad you’re testing handles a caller in a noisy place. Chat simulations ignore background sound.
GPT-Live AI testers add background sound only while they’re speaking, not during silence. They also don’t play the Office preset, so choose another one.
In the Dashboard, open the Personality tab, expand Advanced settings, and turn on Background sound. Turning it on selects White noise. To change it, select another preset or Custom URL.
Office is the quietest preset, at about 30 dB below the AI tester’s speech. The others play about 15 dB below it.
With Custom URL, enter a public HTTPS URL of up to 1,000 characters that points to an audio file of 25 MB or less. The file loops for the whole call. Use WAV when you can, because an MP3 file can leave a short gap at the loop point.
Through the API, set backgroundSound in the personality’s assistant to a preset’s API value or your own URL:
Include the rest of the personality’s assistant configuration in the same request, as described in Configure the AI tester.
The assistant or squad you’re testing denoises incoming audio before it transcribes and records the call. Smart Denoising is on by default, so it removes most of the background sound, and the recording may sound clean. A clean recording is expected, because the simulation tests your production setup.
Hear the raw noise
To hear the raw noise, turn off denoising in the scenario’s targetOverrides. Also set backgroundDenoisingEnabled to false, because this legacy flag takes precedence when the assistant or squad you’re testing sets it:
If the assistant or squad you’re testing enables Fourier denoising, also set backgroundSpeechDenoisingPlan.fourierDenoisingPlan.enabled to false. Updating a scenario replaces its targetOverrides, so include any existing overrides you want to keep.