Eval

Create Eval

Headers

AuthorizationstringRequired

Bearer authentication of the form Bearer <token>, where token is your auth token.

Request

This endpoint expects an object.
messageslist of objectsRequired
This is the mock conversation that will be used to evaluate the flow of the conversation. Mock Messages are used to simulate the flow of the conversation Evaluation Messages are used as checkpoints in the flow where the model's response to previous conversation needs to be evaluated to check the content and tool calls
typeenumRequired

This is the type of the eval. Currently it is fixed to chat.mockConversation.

Allowed values:
namestringOptional>=1 character<=80 characters
This is the name of the eval. It helps identify what the eval is checking for.
descriptionstringOptional>=1 character<=500 characters
This is the description of the eval. This helps describe the eval and its purpose in detail. It will not be used to evaluate the flow of the conversation.

Response

messageslist of objects
This is the mock conversation that will be used to evaluate the flow of the conversation. Mock Messages are used to simulate the flow of the conversation Evaluation Messages are used as checkpoints in the flow where the model's response to previous conversation needs to be evaluated to check the content and tool calls
idstring
orgIdstring
createdAtstringformat: "date-time"
updatedAtstringformat: "date-time"
typeenum

This is the type of the eval. Currently it is fixed to chat.mockConversation.

Allowed values:
namestring or null>=1 character<=80 characters
This is the name of the eval. It helps identify what the eval is checking for.
descriptionstring or null>=1 character<=500 characters
This is the description of the eval. This helps describe the eval and its purpose in detail. It will not be used to evaluate the flow of the conversation.