Evals

Checks an eval run up front: validates the agent/model selection, workspace access, and the modelSelection entitlement from the selection alone, with no fixture data.

post/experimental/eval-runs-v2:check

Headers

Authorizationstring

Request body

workspaceNamestring required
agentstring
modelstring
scorerAgentstring
scorerModelstring

Response

Default Response

Changes

Changed in 5 of the 55 revisions of this API.111

    • ○

      added subschema #3 to the / request property anyOf list

      request-property-any-of-added

    • ○

      request property deprecated

      request-property-deprecated

    • ○

      request property // deprecated

      request-property-deprecated

    • ○

      request property // deprecated

      request-property-deprecated

    • ○

      added the required property /// to the response with the status

      response-required-property-added

  • 050f3217cf2c11See the full diff
    • ▲

      removed subschema #1 subschema #2 subschema #3 subschema #4 from the //// request property anyOf list

      request-property-any-of-removed

    • ○

      added subschema #1 subschema #2 to the //// request property anyOf list

      request-property-any-of-added

    • ○

      added the new optional request property

      new-optional-request-property

    • ○

      added the new optional request property

      new-optional-request-property

    • ○

      added the required property /// to the response with the status

      response-required-property-added

    • ○

      added the required property // to the response with the status

      response-required-property-added

    • ○

      added the required property // to the response with the status

      response-required-property-added