ai_evals

the run one iteration of an eval run answered, as its scorers read it

Changed on

Called by the step a run's flow places between the agent and its scorers. Every tool call is enriched with the arguments, result, status and duration of the job that ran it, and with the schema of the script version it ran, none of which the flow itself can read.

get/w/{workspace}/ai_evals/run_payload

Request

  • Base URL: /api (relative, and the document was published on a file host, not at the API’s origin)
  • URL: /api/w/{workspace}/ai_evals/run_payload
  • Auth: one of:
    • HTTP bearer
    • API key in cookie token

Path parameters

workspacestring required

Query parameters

job_idstring uuid required

The flow job that answered the case.

Response

the run and its rendering

runobject required

The case, the answer, and every tool call the agent made.

renderedstring required

The same run as a judge agent is shown it.

Changes