---
title: "Create Evaluation"
method: POST
path: "/simple/evaluations/"
tags: ["Evaluations"]
---

# Create Evaluation

`POST /simple/evaluations/`

## Request body

- SimpleEvaluationCreateRequest
  - `evaluation` SimpleEvaluationCreate, required
    - `flags` EvaluationRunFlags
      - `is_live` boolean
      - `is_active` boolean
      - `is_closed` boolean
      - `is_queue` boolean
      - `is_cached` boolean
      - `is_split` boolean
      - `has_queries` boolean
      - `has_testsets` boolean
      - `has_traces` boolean
      - `has_testcases` boolean
      - `has_evaluators` boolean
      - `has_custom` boolean
      - `has_human` boolean
      - `has_auto` boolean
    - `tags` object, nullable
    - `meta` object, nullable
    - `name` string, nullable
    - `description` string, nullable
    - `version` string
    - `data` SimpleEvaluationData
      - `status` 'pending' | 'queued' | 'running' | 'success' | 'failure' | 'errors' | 'cancelled'
      - `query_steps` union
        - string[]
        - object
      - `testset_steps` union
        - string[]
        - object
      - `application_steps` union
        - string[]
        - object
      - `evaluator_steps` union
        - string[]
        - object
      - `repeats` integer, nullable
      - `concurrency` EvaluationRunDataConcurrency
        - `batch_size` integer, nullable
        - `max_retries` integer, nullable
        - `retry_delay` number, nullable

## Response `200`

Successful Response

- SimpleEvaluationResponse
  - `count` integer
  - `evaluation` SimpleEvaluation
    - `flags` EvaluationRunFlags
      - `is_live` boolean
      - `is_active` boolean
      - `is_closed` boolean
      - `is_queue` boolean
      - `is_cached` boolean
      - `is_split` boolean
      - `has_queries` boolean
      - `has_testsets` boolean
      - `has_traces` boolean
      - `has_testcases` boolean
      - `has_evaluators` boolean
      - `has_custom` boolean
      - `has_human` boolean
      - `has_auto` boolean
    - `tags` object, nullable
    - `meta` object, nullable
    - `name` string, nullable
    - `description` string, nullable
    - `created_at` string, date-time, nullable
    - `updated_at` string, date-time, nullable
    - `deleted_at` string, date-time, nullable
    - `created_by_id` string, uuid, nullable
    - `updated_by_id` string, uuid, nullable
    - `deleted_by_id` string, uuid, nullable
    - `id` string, uuid, nullable
    - `version` string, nullable
    - `data` SimpleEvaluationData
      - `status` 'pending' | 'queued' | 'running' | 'success' | 'failure' | 'errors' | 'cancelled'
      - `query_steps` union
        - string[]
        - object
      - `testset_steps` union
        - string[]
        - object
      - `application_steps` union
        - string[]
        - object
      - `evaluator_steps` union
        - string[]
        - object
      - `repeats` integer, nullable
      - `concurrency` EvaluationRunDataConcurrency
        - `batch_size` integer, nullable
        - `max_retries` integer, nullable
        - `retry_delay` number, nullable

## Other responses

- `422` — Validation Error

## Changes

- **2026-07-25** `5a14788d939f` — 6 info
  - added the new optional request property `evaluation/data/anyOf[subschema #1: SimpleEvaluationData]/concurrency`
  - added the new optional request property `evaluation/flags/anyOf[subschema #1: EvaluationRunFlags]/has_testcases`
  - added the new optional request property `evaluation/flags/anyOf[subschema #1: EvaluationRunFlags]/has_traces`
  - added the optional property `evaluation/anyOf[subschema #1: SimpleEvaluation]/data/anyOf[subschema #1: SimpleEvaluationData]/concurrency` to the response with the `200` status
  - …2 more
- **2026-05-19** `a7f9a6823230` — 2 warning
  - removed the optional property `support_id` from the response with the `200` status
  - removed the optional property `support_ts` from the response with the `200` status
- **2026-05-08** `5e6f53ce5d08` — 1 info
  - api operation id `create_evaluation_simple_evaluations__post` removed and replaced with `create_simple_evaluation`
- **2026-04-23** `925e8b901a26` — 2 info
  - added the optional property `support_id` to the response with the `200` status
  - added the optional property `support_ts` to the response with the `200` status
- …earlier changes not shown

[Full history](https://skmtc.dev/agenta-ai/apis/agenta-api/changes/simple/evaluations/post.md)

---

[API](https://skmtc.dev/agenta-ai/apis/agenta-api.md) · [All operations](https://skmtc.dev/agenta-ai/apis/agenta-api/llms.txt) · [OpenAPI document](https://skmtc-service-production.skmtc.workers.dev/v1/apis/agenta-ai/agenta-api/revisions/48ced00d9a1c/schema)