Sign in
/agents/{id}/datasets/evaluate

Create Evaluation Dataset

Create a new evaluation Dataset for the specified Agent using the provided JSONL or CSV file. A Dataset is a versioned collection of samples conforming to a particular schema, and can be used to store Evaluation test-sets and retrieve Evaluation results.

Each Dataset is versioned and validated against its schema during creation and subsequent updates. The provided Dataset file must conform to the schema defined for the dataset_type.

File schema for dataset_type evaluation_set is a CSV file or a JSONL file where each line is one JSON object. The following keys are required:

  • prompt (string): Prompt or question

  • reference (string): Reference or ground truth response

post/agents/{agent_id}/datasets/evaluate

Path parameters

agent_idstring uuid required

Agent ID to associate with the evaluation dataset

Agent ID to associate with the evaluation dataset

Response

Successful Response

versionstring required

Version number of the dataset

namestring required

Name of the dataset

type'tuning_set' | 'evaluation_set' | 'evaluation_set_prediction' | 'evaluation_run_result' required

Changes