---
title: "Run evaluators on a dataset"
method: POST
path: "/api/datasets/{dataset_id}/eval-reports/create/"
tags: ["datasets"]
---

# Run evaluators on a dataset

`POST /api/datasets/{dataset_id}/eval-reports/create/`

Create dataset evaluation tasks for one or more evaluators.

## Path parameters

- `dataset_id` string, required

## Headers

- `Authorization` string, required

## Request body

- object
  - `evaluator_ids` string[], required — Evaluator IDs to run against the dataset.
  - `experiment_id` string — Optional experiment to associate with the evaluation runs.
  - `generation_method` string — Optional generation strategy. Defaults to `auto`.

## Response `201`

Evaluation tasks created.

- DatasetsRunEvalOnDatasetResponse201
  - `created_tasks` ApiDatasetsDatasetIdEvalReportsCreatePostResponsesContentApplicationJsonSchemaCreatedTasksItems[], required
    - `task_id` string
    - `name` string
    - `dataset_id` string
    - `evaluator_slug` string
    - `status` string
    - `started_at` string, date-time, nullable
    - `completed_at` string, date-time, nullable
    - `error_message` string
    - `evaluated_logs_count` integer, nullable
    - `score` number, double, nullable
  - `errors` object
  - `experiment_updated` boolean
  - `experiment_evaluator_ids` string[]

## Other responses

- `400` — Bad request - missing dataset or evaluator IDs, or evaluator access denied.
- `401` — Unauthorized - Missing or invalid authentication.
- `404` — Dataset not found.

---

[API](https://skmtc.dev/respan/apis/api-reference.md) · [All operations](https://skmtc.dev/respan/apis/api-reference/llms.txt) · [OpenAPI document](https://skmtc-service-production.skmtc.workers.dev/v1/apis/respan/api-reference/revisions/764fca4d43e4/schema)