evals

Create Run

Trigger a new eval run.

Body shapes: scenario {"target": "scenario", "id": <uuid>, "reps"?: int=1} probe {"target": "probe", "id": <uuid>} suite {"target": "suite", "id": <uuid>} -- fans out to children harness {"target": "harness", "harness_path": "tests/replay/test_X.py"}

Common optional: "force_run": true (bypass the daily cost cap)

post/v1/admin/eval/runs

Request body

object required

Response

Successful Response

{"stackTrail":"paths:/v1/admin/eval/runs:post:responses:200:content:application/json:schema","oasType":"schema","type":"unknown"}

Changes

No recorded changes to this endpoint across all 1 revision of this API.