---
title: "Create Evaluator"
method: POST
path: "/preview/evaluators/"
tags: ["Evaluators"]
---

# Create Evaluator

`POST /preview/evaluators/`

## Query parameters

- `evaluator_id` string, uuid, nullable

## Request body

- EvaluatorCreateRequest
  - `evaluator` EvaluatorCreate, required
    - `flags` EvaluatorFlags
      - `is_custom` boolean
      - `is_evaluator` boolean
      - `is_human` boolean
    - `tags` object, nullable
    - `meta` object, nullable
    - `name` string, nullable
    - `description` string, nullable
    - `slug` string, nullable

## Response `200`

Successful Response

- EvaluatorResponse
  - `count` integer
  - `evaluator` Evaluator
    - `flags` EvaluatorFlags
      - `is_custom` boolean
      - `is_evaluator` boolean
      - `is_human` boolean
    - `tags` object, nullable
    - `meta` object, nullable
    - `name` string, nullable
    - `description` string, nullable
    - `created_at` string, date-time, nullable
    - `updated_at` string, date-time, nullable
    - `deleted_at` string, date-time, nullable
    - `created_by_id` string, uuid, nullable
    - `updated_by_id` string, uuid, nullable
    - `deleted_by_id` string, uuid, nullable
    - `slug` string, nullable
    - `id` string, uuid, nullable

## Other responses

- `422` — Validation Error

## Changes

- **2026-01-14** `53da4c9de2b7` — 4 breaking, 10 info
  - request property `evaluator/flags/anyOf[subschema #1: EvaluatorFlags]/is_custom` list-of-types was narrowed by removing types `null` from media type `application/json`
  - request property `evaluator/flags/anyOf[subschema #1: EvaluatorFlags]/is_evaluator` list-of-types was narrowed by removing types `null` from media type `application/json`
  - request property `evaluator/flags/anyOf[subschema #1: EvaluatorFlags]/is_human` list-of-types was narrowed by removing types `null` from media type `application/json`
  - request property `evaluator/tags/anyOf[subschema #1]/additionalProperties/` list-of-types was narrowed by removing types `integer, null and number` from media type `application/json`
  - …10 more
- **2025-11-05** `e62506c24377` — 2 breaking, 9 warning, 9 info
  - removed `#/components/schemas/WorkflowFlags` from the `evaluator/flags` request property `anyOf` list
  - the response property `count` became optional for the status `200`
  - removed the request property `evaluator/created_at`
  - removed the request property `evaluator/created_by_id`
  - …16 more
- **2025-06-27** `e3e84db47198` — 1 info
  - endpoint added

[Change history](https://skmtc.dev/agenta-ai/apis/agenta-api/changes/preview/evaluators/post.md)

---

[API](https://skmtc.dev/agenta-ai/apis/agenta-api.md) · [All operations](https://skmtc.dev/agenta-ai/apis/agenta-api/llms.txt) · [OpenAPI document](https://skmtc.dev/agenta-ai/apis/agenta-api/revisions/53da4c9de2b7?raw)