Sign in
Eval runs

Get one eval case

A case that belongs to this suite and project. A case in another suite is a 404, not a 403.

get/projects/{projectId}/eval-suites/{suiteId}/cases/{caseId}

Path parameters

projectIdstring required

ID of the hosted project that contains the server.

suiteIdstring required

Eval suite ID, as returned by POST /eval-runs.

caseIdstring required

Eval case id.

Response

The case.

idstring required
declaredIdstring

The case's effective declared id. Absent on cases authored before declared identity existed.

titlestring required
expectedOutputstring
iterationsinteger required
repetitionsinteger

Trials this case runs under verdict policy 2, overriding the suite default. Absent means the case inherits it. NOT a second spelling of iterations: that one is the legacy count, which the legacy resolver reads as a FLOOR (max(iterations, suite.minimumIterations)) and which a policy-2 case still reports for compatibility. This one is exact.

passThresholdnumber

Fraction of this case's trials that must pass, overriding the suite default. Absent means the case inherits it. Never derived from the suite's minimumAccuracy, which is a PERCENT under a different resolver.

isNegativeboolean required

When true, the case passes if NO tools are called.

scenariostring
intentstring

Optional authored analytics grouping label. Must be already trimmed; absent means unlabelled.

matchOptionsobject

Absent when the case sets none — omitted from the response rather than sent as null.

createdAtnumber nullable
updatedAtnumber nullable

Changes

Changed in 5 of the 74 revisions of this API.6

  • d9a00becd4761See the full diff
    • ○

      added the optional property intent to the response with the 200 status

      response-optional-property-added

  • e81e8ba8baae1See the full diff
    • ○

      added the optional property import to the response with the 200 status

      response-optional-property-added

  • c479eeceb7a32See the full diff
    • ○

      added the optional property passThreshold to the response with the 200 status

      response-optional-property-added

    • ○

      added the optional property repetitions to the response with the 200 status

      response-optional-property-added

  • 879ca349c8041See the full diff
    • ○

      added the optional property declaredId to the response with the 200 status

      response-optional-property-added

  • c5f6167955e41See the full diff
    • ○

      endpoint added

      endpoint-added