Evals

Creates an eval run.

post/experimental/eval-runs-v2

Headers

Authorizationstring

Request body

workspaceNamestring required
scenariosobject required

Per-scenario tarballs and fixtures, keyed by scenario path

evalRunFixturesobject
skipForcedContextActivationboolean
skipScoringboolean
agentstring
modelstring
scorerAgentstring
scorerModelstring
runsinteger
skipSolvedboolean
runQualityCheckboolean
labelstring

Response

Default Response

Changes

No recorded changes to this endpoint across all 26 revisions of this API.