Sign in
EVALS

Batch Run Eval

Run evaluations for multiple test cases. Allows selecting specific test cases and naming the run.

post/evals/batch-run

Query parameters

navigationSourcestring nullable

Request body

test_case_idsstring[] required
run_namestring nullable
session_idstring nullable

Response

Successful Response

run_namestring nullable
totalinteger required
successfulinteger required
failedinteger required

Changes

Changed in 1 of the 28 revisions of this API.25

  • 103580dad81625See the full diff
    • ▲

      the response property results/items/overall_score became optional for the status 200

      response-property-became-optional

    • ▲

      response property results/items/overall_score list-of-types was widened by adding types null to media type application/json of response 200

      response-property-list-of-types-widened

    • ○

      added the optional property results/items/judge_errors to the response with the 200 status

      response-optional-property-added

    • ○

      added the optional property results/items/judge_model to the response with the 200 status

      response-optional-property-added

    • ○

      added the optional property results/items/run_tenant to the response with the 200 status

      response-optional-property-added

    • ○

      added the optional property results/items/status to the response with the 200 status

      response-optional-property-added

    • ○

      added the optional property results/items/test_case_id to the response with the 200 status

      response-optional-property-added