Sign in
datasets

Run evaluators on a dataset

Create dataset evaluation tasks for one or more evaluators.

post/api/datasets/{dataset_id}/eval-reports/create/

Path parameters

dataset_idstring required

Dataset ID.

Headers

Authorizationstring required

Use your Respan API key for Respan API authentication. Enter only the Respan API key value; clients send Authorization: Bearer <RESPAN_API_KEY>. For /api/responses, provider credentials such as Perplexity, OpenAI, or Azure OpenAI go in Settings -> Providers or respan_params.credential_override in the request body, not in this authentication field.

Request body

evaluator_idsstring[] required

Evaluator IDs to run against the dataset.

experiment_idstring

Optional experiment to associate with the evaluation runs.

generation_methodstring

Optional generation strategy. Defaults to auto.

Response

Evaluation tasks created.

errorsobject
experiment_updatedboolean
experiment_evaluator_idsstring[]

Changes