Agent Evals

Get a benchmark with its cases.

get/api/v0/agent/evals/benchmarks/{benchmark_id}

Request

Path parameters

benchmark_idstring uuid required

Response

Successful Response

idstring uuid required

The ID of the benchmark.

namestring required

The benchmark's name.

persona_idstring uuid nullable

The persona a run uses unless it names another. Null for the default.

rubricstring required

Instructions the judge grades every case by.

created_atstring date-time required

When the benchmark was created.

updated_atstring date-time required

When the benchmark or its cases last changed.

Changes