Eval runs

List a suite's runs

Recent runs for a suite, newest first.

get/projects/{projectId}/eval-suites/{suiteId}/runs

Path parameters

projectIdstring required

ID of the hosted project that contains the server.

suiteIdstring required

Eval suite ID, as returned by POST /eval-runs.

Query parameters

limitinteger

Maximum runs to return, 1–100. Defaults to 25.

Response

Recent runs, newest first.

Changes

Changed in 12 of the 80 revisions of this API.3816

    • added the optional property items/items/judges/allOf[EvalRunJudges]/goalCompletion/cases/items/iterationId to the response with the 200 status

      response-optional-property-added

    • added the optional property items/items/judges/allOf[EvalRunJudges]/groundedness/cases/items/iterationId to the response with the 200 status

      response-optional-property-added

    • added the optional property items/items/importEligibility to the response with the 200 status

      response-optional-property-added

    • added the optional property items/items/gateWaiver to the response with the 200 status

      response-optional-property-added

  • c479eeceb7a313See the full diff
    • added the new inconclusive enum value to the items/items/result response property for the response status 200

      response-property-enum-value-added

    • added the optional property items/items/verdictPolicyIntegrityError to the response with the 200 status

      response-optional-property-added

    • added the optional property items/items/verdictPolicyVersion to the response with the 200 status

      response-optional-property-added

    • added the optional property items/items/verdictSummary to the response with the 200 status

      response-optional-property-added

    • added the optional property items/items/effectiveModelId to the response with the 200 status

      response-optional-property-added

    • added the optional property items/items/modelSource to the response with the 200 status

      response-optional-property-added

    • added the optional property items/items/runGroupId to the response with the 200 status

      response-optional-property-added

    • added the optional property items/items/executionEngine to the response with the 200 status

      response-optional-property-added

    • added the optional property items/items/judges to the response with the 200 status

      response-optional-property-added

  • d3adfe49fbbf321See the full diff
    • added EvalRunEnvironment subschema #2 to the items/items/environment response property oneOf list for the response status 200

      response-property-one-of-added

    • the items/items/environment response's property type/format changed from object null/ to / for status 200

      response-property-type-changed

    • removed the required property items/items/environment/id from the response with the 200 status

      response-required-property-removed

    • removed the optional property items/items/environment/name from the response with the 200 status

      response-optional-property-removed

    • removed the optional property items/items/environment/revision from the response with the 200 status

      response-optional-property-removed

    • added the optional property items/items/insights to the response with the 200 status

      response-optional-property-added

    • added the optional property items/items/scoreIntegrity to the response with the 200 status

      response-optional-property-added

    • added the optional property items/items/environment to the response with the 200 status

      response-optional-property-added