---
title: "Create Evaluation Dataset"
method: POST
path: "/agents/{agent_id}/datasets/evaluate"
tags: ["/agents/{id}/datasets/evaluate"]
---

# Create Evaluation Dataset

`POST /agents/{agent_id}/datasets/evaluate`

Create a new evaluation `Dataset` for the specified `Agent` using the provided JSONL or CSV file. A `Dataset` is a versioned collection of samples conforming to a particular schema, and can be used to store `Evaluation` test-sets and retrieve `Evaluation` results.

Each `Dataset` is versioned and validated against its schema during creation and subsequent updates. The provided `Dataset` file must conform to the schema defined for the `dataset_type`.

File schema for `dataset_type` `evaluation_set` is a CSV file or a JSONL file where each line is one JSON object. The following keys are required:

- `prompt` (`string`): Prompt or question

- `reference` (`string`): Reference or ground truth response

## Path parameters

- `agent_id` string, uuid, required — Agent ID to associate with the evaluation dataset

## Response `200`

Successful Response

- CreateDatasetResponse — Response to POST /datasets request
  - `version` string, required — Version number of the dataset
  - `name` string, required — Name of the dataset
  - `type` 'tuning_set' | 'evaluation_set' | 'evaluation_set_prediction' | 'evaluation_run_result', required

## Other responses

- `422` — Validation Error

## Changes

- **2025-01-15** `4ed32c3243ce` — 2 info
  - api tag `/agents/{id}/datasets/evaluate` added
  - api tag `/agents/{id}/datasets` removed
- **2025-01-14** `448bcb901d30` — 1 info
  - endpoint added

[Change history](https://skmtc.dev/contextualai/apis/endpoints/changes/agents/:agent_id/datasets/evaluate/post.md)

---

[API](https://skmtc.dev/contextualai/apis/endpoints.md) · [All operations](https://skmtc.dev/contextualai/apis/endpoints/llms.txt) · [OpenAPI document](https://skmtc-service-production.skmtc.workers.dev/v1/apis/contextualai/endpoints/revisions/17bdb8a33fb4/schema)