---
title: "Run evaluators on a dataset"
method: POST
path: "/api/datasets/{dataset_id}/eval-reports/create/"
tags: ["datasets"]
---

# Run evaluators on a dataset

`POST /api/datasets/{dataset_id}/eval-reports/create/`

Create dataset evaluation tasks for one or more evaluators.

## Path parameters

- `dataset_id` string, required

## Headers

- `Authorization` string, required

## Request body

- object
  - `evaluator_ids` string[], required — Evaluator IDs to run against the dataset.
  - `experiment_id` string — Optional experiment to associate with the evaluation runs.
  - `generation_method` string — Optional generation strategy. Defaults to `auto`.

## Response `201`

Evaluation tasks created.

- DatasetsRunEvalOnDatasetResponse201
  - `created_tasks` ApiDatasetsDatasetIdEvalReportsCreatePostResponsesContentApplicationJsonSchemaCreatedTasksItems[], required
    - `task_id` string
    - `name` string
    - `dataset_id` string
    - `evaluator_slug` string
    - `status` string
    - `started_at` string, date-time, nullable
    - `completed_at` string, date-time, nullable
    - `error_message` string
    - `evaluated_logs_count` integer, nullable
    - `score` number, double, nullable
  - `errors` object
  - `experiment_updated` boolean
  - `experiment_evaluator_ids` string[]

## Other responses

- `400` — Bad request - missing dataset or evaluator IDs, or evaluator access denied.
- `401` — Unauthorized - Missing or invalid authentication.
- `404` — Dataset not found.

## Changes

> 6 revisions in range; 3 could not be searched.

- **2026-07-31** `c26d550029f8` — 4 breaking, 5 warning, 8 info
  - added the new required request property `dataset_id`
  - added the new required request property `evaluator_slug`
  - added the new required request property `unique_organization_id`
  - removed the required property `created_tasks` from the response with the `201` status
  - …13 more

[Change history](https://skmtc.dev/keywordsai/apis/api-reference/changes/api/datasets/:dataset_id/eval-reports/create/post.md)

---

[API](https://skmtc.dev/keywordsai/apis/api-reference.md) · [All operations](https://skmtc.dev/keywordsai/apis/api-reference/llms.txt) · [OpenAPI document](https://skmtc-service-production.skmtc.workers.dev/v1/apis/keywordsai/api-reference/revisions/c61efaf24756/schema)