Agent Evals

List Benchmarks

Changed on

List the user's benchmarks with each one's newest run, and the models a run uses by default.

get/api/v0/agent/evals/benchmarks

Request

Response

Successful Response

agent_modelstring required

The model a run uses for the agent unless it names another.

judge_modelstring required

The model a run grades with, from Settings.

agent_modelsstring[] required

Models a run may name for the agent. Empty when the tier has no model selection.

Changes

    • info

      added the optional property //// to the response with the status

    • info

      added the optional property //// to the response with the status

    • info

      added the optional property ////// to the response with the status

    • info

      added the optional property ////// to the response with the status

    • info

      endpoint added