Eval runs

Rerun a run's failed cases

Replay a finished run's frozen snapshot narrowed to the cases that did not pass: every case with a trial that is not completed and passed (cancelled and skipped trials do not count). The platform selects the cases — see the rerun preview. The new run records rerunOfRunId and rerunScope, and because its pass rate is biased by that selection it is never used as the suite's latest run, a trend point, or a comparison/gate baseline. Returns 409 with details.reason RERUN_NOTHING_TO_RERUN when nothing qualifies, or RERUN_SOURCE_NOT_TERMINAL while the run is still in flight. Honors the Idempotency-Key header.

post/projects/{projectId}/eval-runs/{runId}/rerun

Path parameters

projectIdstring required

ID of the hosted project that contains the server.

runIdstring required

Eval run ID, as returned by POST /eval-runs.

Request body

scope'failed_cases' required

The only scope: every case with a trial that did not complete and pass.

notesstring
idempotencyKeystring

Response

The rerun was started (or, on an idempotent retry, the run it already started).

runIdstring required
suiteIdstring required
statusstring required
dedupedboolean
rerunOfRunIdstring required
rerunScope'failed_cases' required

Changes

Changed in 1 of the 133 revisions of this API.1