---
title: "Create Evaluator"
method: POST
path: "/preview/evaluators/"
tags: ["Evaluators"]
---

# Create Evaluator

`POST /preview/evaluators/`

## Query parameters

- `evaluator_id` string, uuid, nullable

## Request body

- EvaluatorCreateRequest
  - `evaluator` EvaluatorCreate, required
    - `folder_id` string, uuid, nullable
    - `flags` EvaluatorFlags
      - `is_custom` boolean
      - `is_evaluator` boolean
      - `is_human` boolean
      - `is_chat` boolean
    - `tags` object, nullable
    - `meta` object, nullable
    - `name` string, nullable
    - `description` string, nullable
    - `slug` string, nullable

## Response `200`

Successful Response

- EvaluatorResponse
  - `count` integer
  - `evaluator` Evaluator
    - `folder_id` string, uuid, nullable
    - `flags` EvaluatorFlags
      - `is_custom` boolean
      - `is_evaluator` boolean
      - `is_human` boolean
      - `is_chat` boolean
    - `tags` object, nullable
    - `meta` object, nullable
    - `name` string, nullable
    - `description` string, nullable
    - `created_at` string, date-time, nullable
    - `updated_at` string, date-time, nullable
    - `deleted_at` string, date-time, nullable
    - `created_by_id` string, uuid, nullable
    - `updated_by_id` string, uuid, nullable
    - `deleted_by_id` string, uuid, nullable
    - `slug` string, nullable
    - `id` string, uuid, nullable

## Other responses

- `422` — Validation Error

## Changes

- **2026-02-13** `72fe88316d15` — 6 info
  - added the new optional request property `evaluator/flags/anyOf[subschema #1: EvaluatorFlags]/is_chat`
  - added the new optional request property `evaluator/folder_id`
  - added the optional property `detail/items/ctx` to the response with the `422` status
  - added the optional property `detail/items/input` to the response with the `422` status
  - …2 more
- **2026-01-14** `53da4c9de2b7` — 4 breaking, 10 info
  - request property `evaluator/flags/anyOf[subschema #1: EvaluatorFlags]/is_custom` list-of-types was narrowed by removing types `null` from media type `application/json`
  - request property `evaluator/flags/anyOf[subschema #1: EvaluatorFlags]/is_evaluator` list-of-types was narrowed by removing types `null` from media type `application/json`
  - request property `evaluator/flags/anyOf[subschema #1: EvaluatorFlags]/is_human` list-of-types was narrowed by removing types `null` from media type `application/json`
  - request property `evaluator/tags/anyOf[subschema #1]/additionalProperties/` list-of-types was narrowed by removing types `integer, null and number` from media type `application/json`
  - …10 more
- …earlier changes not shown

[Full history](https://skmtc.dev/agenta-ai/apis/agenta-api/changes/preview/evaluators/post.md)

---

[API](https://skmtc.dev/agenta-ai/apis/agenta-api.md) · [All operations](https://skmtc.dev/agenta-ai/apis/agenta-api/llms.txt) · [OpenAPI document](https://skmtc-service-production.skmtc.workers.dev/v1/apis/agenta-ai/agenta-api/revisions/72fe88316d15/schema)