Sign in
projects

List Evaluation Suite Runs

List immutable execution history for one project Evaluation Suite.

Args: project_id: Owning project. suite_id: Evaluation Suite ID. request: Incoming request, used to hide confirmation runs from run keys. auth: Authenticated requester. limit: Maximum rows to return (capped at 200).

Returns: Evaluation Suite run records newest first.

get/projects/{project_id}/evaluation-suites/{suite_id}/runs

Path parameters

project_idstring required
suite_idstring required

Query parameters

limitinteger

Response

Successful Response

idstring required
suite_idstring required
project_idstring required
model_idstring required
status'awaiting_scoring' | 'cancelled' | 'complete' | 'failed' | 'pending' | 'running' required
max_examplesinteger nullable required
scorer_snapshotJsonObjectOutput required
comparison_groupstring nullable required

Scorer id, version, and behaviour digest. Runs without the same non-null value must not be ranked or compared.

metricsJsonObjectOutput required
error_messagestring nullable required
created_atstring date-time required
started_atstring date-time nullable required
lease_expires_atstring date-time nullable required
scoring_expires_atstring date-time nullable required
completed_atstring date-time nullable required

Changes