---
title: "Start Evaluation"
method: POST
path: "/evaluations/preview/start"
tags: ["Evaluations"]
---

# Start Evaluation

`POST /evaluations/preview/start`

## Request body

- NewEvaluation
  - `name` string, nullable
  - `revisions_ids` string[], required
  - `evaluator_ids` string[], required
  - `testset_revision_id` string, required
  - `rate_limit` LLMRunRateLimit, required
    - `batch_size` integer, required
    - `max_retries` integer, required
    - `retry_delay` integer, required
    - `delay_between_batches` integer, required
  - `correct_answer_column` string, nullable

## Response `200`

Successful Response

- EvaluationRunsResponse
  - `count` integer
  - `runs` EvaluationRun[]
    - `flags` EvaluationRunFlags
      - `is_live` boolean
      - `is_active` boolean
      - `is_closed` boolean
      - `has_queries` boolean
      - `has_testsets` boolean
      - `has_evaluators` boolean
      - `has_custom` boolean
      - `has_human` boolean
      - `has_auto` boolean
    - `tags` object, nullable
    - `meta` object, nullable
    - `name` string, nullable
    - `description` string, nullable
    - `created_at` string, date-time, nullable
    - `updated_at` string, date-time, nullable
    - `deleted_at` string, date-time, nullable
    - `created_by_id` string, uuid, nullable
    - `updated_by_id` string, uuid, nullable
    - `deleted_by_id` string, uuid, nullable
    - `id` string, uuid, nullable
    - `version` string, nullable
    - `status` 'pending' | 'queued' | 'running' | 'success' | 'failure' | 'errors' | 'cancelled'
    - `data` EvaluationRunDataOutput
      - `steps` EvaluationRunDataStep[], nullable
        - `key` string, required
        - `type` 'input' | 'invocation' | 'annotation', required
        - `origin` 'custom' | 'human' | 'auto', required
        - `references` object, required
        - `inputs` EvaluationRunDataStepInput[], nullable
          - `key` string, required
      - `repeats` integer, nullable
      - `mappings` EvaluationRunDataMapping[], nullable
        - `column` EvaluationRunDataMappingColumn, required
          - `kind` string, required
          - `name` string, required
        - `step` EvaluationRunDataMappingStep, required
          - `key` string, required
          - `path` string, required
  - `windowing` Windowing
    - `newest` string, date-time, nullable
    - `oldest` string, date-time, nullable
    - `next` string, uuid, nullable
    - `limit` integer, nullable
    - `order` 'ascending' | 'descending', nullable
    - `interval` integer, nullable
    - `rate` number, nullable

## Other responses

- `422` — Validation Error

## Changes

- **2026-02-13** `72fe88316d15` — 1 breaking, 1 warning, 2 info
  - added the new required request property `evaluator_ids`
  - removed the request property `evaluators_configs`
  - added the optional property `detail/items/ctx` to the response with the `422` status
  - added the optional property `detail/items/input` to the response with the `422` status
- **2026-01-14** `53da4c9de2b7` — 1 breaking, 1 warning, 14 info
  - added the new required request property `testset_revision_id`
  - removed the request property `testset_id`
  - added the optional property `runs/items/flags/anyOf[subschema #1: EvaluationRunFlags]/has_auto` to the response with the `200` status
  - added the optional property `runs/items/flags/anyOf[subschema #1: EvaluationRunFlags]/has_custom` to the response with the `200` status
  - …12 more
- **2025-11-05** `e62506c24377` — 1 info
  - endpoint added

[Change history](https://skmtc.dev/agenta-ai/apis/agenta-api/changes/evaluations/preview/start/post.md)

---

[API](https://skmtc.dev/agenta-ai/apis/agenta-api.md) · [All operations](https://skmtc.dev/agenta-ai/apis/agenta-api/llms.txt) · [OpenAPI document](https://skmtc-service-production.skmtc.workers.dev/v1/apis/agenta-ai/agenta-api/revisions/72fe88316d15/schema)