Sign in
Eval runs

Update an eval case

Partial update — omitted fields are left as they are. Supplying steps REPLACES the case's definition rather than merging into it. matchOptions and checks accept null to clear the case-level override and fall back to the suite's.

patch/projects/{projectId}/eval-suites/{suiteId}/cases/{caseId}

Path parameters

projectIdstring required

ID of the hosted project that contains the server.

suiteIdstring required

Eval suite ID, as returned by POST /eval-runs.

caseIdstring required

Eval case id.

Request body

titlestring
expectedOutputstring
iterationsinteger
repetitionsinteger

Per-case repetitions under verdict policy 2; omitted cases inherit the suite default.

passThresholdnumber

Per-case pass threshold fraction under verdict policy 2.

isNegativeboolean
scenariostring
intentstring nullable

Optional authored analytics grouping label. Must be already trimmed; omitted leaves the stored value unchanged and null clears it.

matchOptionsobject nullable

null clears the case override and inherits the suite's.

Response

The updated case.

idstring required
declaredIdstring

The case's effective declared id. Absent on cases authored before declared identity existed.

titlestring required
expectedOutputstring
iterationsinteger required
repetitionsinteger

Trials this case runs under verdict policy 2, overriding the suite default. Absent means the case inherits it. NOT a second spelling of iterations: that one is the legacy count, which the legacy resolver reads as a FLOOR (max(iterations, suite.minimumIterations)) and which a policy-2 case still reports for compatibility. This one is exact.

passThresholdnumber

Fraction of this case's trials that must pass, overriding the suite default. Absent means the case inherits it. Never derived from the suite's minimumAccuracy, which is a PERCENT under a different resolver.

isNegativeboolean required

When true, the case passes if NO tools are called.

scenariostring
intentstring

Optional authored analytics grouping label. Must be already trimmed; absent means unlabelled.

matchOptionsobject

Absent when the case sets none — omitted from the response rather than sent as null.

createdAtnumber nullable
updatedAtnumber nullable

Changes