CEcekura
test_framework

Create evaluator from transcript

Changed on

Create an evaluator from a call transcript and return it once it is ready. transcript_json is a list of {role, content, start_time} messages, where role is Main Agent, Testing Agent, Function Call or Function Call Result. Usually takes under 2 minutes.

post/test_framework/v3/scenarios/create-from-transcript/

Request

  • Base URL
    https://api.cekura.ai
  • URL
    https://api.cekura.ai/test_framework/v3/scenarios/create-from-transcript/
  • Auth
    • API key in header X-CEKURA-API-KEY
    • or HTTP bearer
    • or HTTP bearer

Request body

personalityinteger

ID of the personality to use in the simulation

agentinteger

ID of the agent to use in the simulation

assistant_idstring

Assistant ID to use in the simulation

namestring

Name for the simulated scenario

expected_outcome_promptstring

Prompt describing the expected outcome of the scenario

folder_pathstring nullable

Folder path to assign the scenario to, e.g. "Sales" or "Sales.Inbound". Created when it does not already exist; a new folder nests at most one level deep.

Response

status'completed' | 'failed'

failed when the job could not produce its result; see error / errors.

agent_idinteger
scenario_idinteger nullable
scenarioobject nullable

The created evaluator.

errorstring nullable

Why the job failed, when it did.

Changes