Sign in
Eval runs

Preview deterministic draft evaluators against stored evidence

Requires suite configuration permission and a terminal run. Reserves a 60-second deterministic-preview cooldown, independent of judge previews. Supply the returned continuation object with the unchanged draft to read the next bounded population. Reads at most 100 iterations within a 30-second operation deadline; partial evidence is explicitly ungradable. Runs no model calls and never overwrites original verdicts. Draft assertions explicitly replace, extend, or inherit the frozen rules.

post/projects/{projectId}/eval-runs/{runId}/backtest

Path parameters

projectIdstring required

ID of the hosted project that contains the server.

runIdstring required

Eval run ID, as returned by POST /eval-runs.

Request body

matchOptionsobject nullable

Optional deterministic tool matching options; null omits matching.

Response

Draft evidence comparison.

{"stackTrail":"components:schemas:EvalBacktestReport:properties:schemaVersion","oasType":"schema","type":"unknown"}
sourceRunIdstring required
sourceHashstring required
draftHashstring required
{"stackTrail":"components:schemas:EvalBacktestReport:properties:configRevision","oasType":"schema","type":"unknown"}
completeboolean required
continuationAvailableboolean required
differencesobject[] required
modelUse'none' required

Changes