Sign in
experiments

Get incomplete evaluations for an experiment

Get experiment runs that have incomplete evaluations.

Returns runs with:

  • Missing evaluations (evaluator has not been run)
  • Failed evaluations (evaluator ran but has errors)

Args: experiment_id: The ID of the experiment evaluation_name: List of evaluation names to check (required, at least one) cursor: Cursor for pagination limit: Maximum number of results to return

Returns: Paginated list of runs with incomplete evaluations

get/v1/experiments/{experiment_id}/incomplete-evaluations

Path parameters

experiment_idstring required

Query parameters

evaluation_namestring[]

Evaluation names to check

Evaluation names to check

cursorstring nullable

Cursor for pagination

Cursor for pagination

limitinteger

Maximum number of runs with incomplete evaluations to return

Maximum number of runs with incomplete evaluations to return

Response

Incomplete evaluations retrieved successfully

next_cursorstring nullable required

Changes

Changed in 3 of the 70 revisions of this API.12

  • 9be0bb4dbefc1See the full diff
    • ○

      added the optional property data/items/dataset_example/source to the response with the 200 status

      response-optional-property-added

  • 02361ac1935f1See the full diff
    • ○

      added the required property data/items/dataset_example/node_id to the response with the 200 status

      response-required-property-added

  • c81391216eb51See the full diff
    • ▲

      removed the required property data/items/dataset_example/node_id from the response with the 200 status

      response-required-property-removed

    This revision also has 91 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog