---
title: "Create Evaluation"
method: POST
path: "/simple/evaluations/"
tags: ["Evaluations"]
---

# Create Evaluation

`POST /simple/evaluations/`

## Request body

- SimpleEvaluationCreateRequest
  - `evaluation` SimpleEvaluationCreate, required
    - `flags` EvaluationRunFlags
      - `is_live` boolean
      - `is_active` boolean
      - `is_closed` boolean
      - `is_queue` boolean
      - `is_cached` boolean
      - `is_split` boolean
      - `has_queries` boolean
      - `has_testsets` boolean
      - `has_evaluators` boolean
      - `has_custom` boolean
      - `has_human` boolean
      - `has_auto` boolean
    - `tags` object, nullable
    - `meta` object, nullable
    - `name` string, nullable
    - `description` string, nullable
    - `version` string
    - `data` SimpleEvaluationData
      - `status` 'pending' | 'queued' | 'running' | 'success' | 'failure' | 'errors' | 'cancelled'
      - `query_steps` union
        - string[]
        - object
      - `testset_steps` union
        - string[]
        - object
      - `application_steps` union
        - string[]
        - object
      - `evaluator_steps` union
        - string[]
        - object
      - `repeats` integer, nullable

## Response `200`

Successful Response

- SimpleEvaluationResponse
  - `count` integer
  - `evaluation` SimpleEvaluation
    - `flags` EvaluationRunFlags
      - `is_live` boolean
      - `is_active` boolean
      - `is_closed` boolean
      - `is_queue` boolean
      - `is_cached` boolean
      - `is_split` boolean
      - `has_queries` boolean
      - `has_testsets` boolean
      - `has_evaluators` boolean
      - `has_custom` boolean
      - `has_human` boolean
      - `has_auto` boolean
    - `tags` object, nullable
    - `meta` object, nullable
    - `name` string, nullable
    - `description` string, nullable
    - `created_at` string, date-time, nullable
    - `updated_at` string, date-time, nullable
    - `deleted_at` string, date-time, nullable
    - `created_by_id` string, uuid, nullable
    - `updated_by_id` string, uuid, nullable
    - `deleted_by_id` string, uuid, nullable
    - `id` string, uuid, nullable
    - `version` string, nullable
    - `data` SimpleEvaluationData
      - `status` 'pending' | 'queued' | 'running' | 'success' | 'failure' | 'errors' | 'cancelled'
      - `query_steps` union
        - string[]
        - object
      - `testset_steps` union
        - string[]
        - object
      - `application_steps` union
        - string[]
        - object
      - `evaluator_steps` union
        - string[]
        - object
      - `repeats` integer, nullable

## Other responses

- `422` — Validation Error

## Changes

- **2026-04-16** `8b06b786c977` — 1 warning, 4 info
  - removed the request property `jit`
  - added the new optional request property `evaluation/flags/anyOf[subschema #1: EvaluationRunFlags]/is_cached`
  - added the new optional request property `evaluation/flags/anyOf[subschema #1: EvaluationRunFlags]/is_split`
  - added the optional property `evaluation/anyOf[subschema #1: SimpleEvaluation]/flags/anyOf[subschema #1: EvaluationRunFlags]/is_cached` to the response with the `200` status
  - …1 more
- **2026-03-04** `c8917fecb5bf` — 2 info
  - added the new optional request property `evaluation/flags/anyOf[subschema #1: EvaluationRunFlags]/is_queue`
  - added the optional property `evaluation/anyOf[subschema #1: SimpleEvaluation]/flags/anyOf[subschema #1: EvaluationRunFlags]/is_queue` to the response with the `200` status
- **2026-02-27** `8fcd55a5a656` — 1 info
  - endpoint added
- **2025-06-27** `e3e84db47198` — 1 breaking
  - api path removed without deprecation

[Change history](https://skmtc.dev/agenta-ai/apis/agenta-api/changes/simple/evaluations/post.md)

---

[API](https://skmtc.dev/agenta-ai/apis/agenta-api.md) · [All operations](https://skmtc.dev/agenta-ai/apis/agenta-api/llms.txt) · [OpenAPI document](https://skmtc-service-production.skmtc.workers.dev/v1/apis/agenta-ai/agenta-api/revisions/c469c2f6cdba/schema)