Agent Evals

Update Benchmark

Changed on

Rename a benchmark, change its persona, or rewrite its judge instructions.

patch/api/v0/agent/evals/benchmarks/{benchmark_id}

Request

Path parameters

benchmark_idstring uuid required

Request body

namestring nullable
persona_idstring uuid nullable

The persona runs use. Omitted, it is unchanged; null sets the default persona.

rubricstring nullable

Response

Successful Response

idstring uuid required

The ID of the benchmark.

namestring required

The benchmark's name.

persona_idstring uuid nullable

The persona a run uses unless it names another. Null for the default.

rubricstring required

Instructions the judge grades every case by.

created_atstring date-time required

When the benchmark was created.

updated_atstring date-time required

When the benchmark or its cases last changed.

Changes