---
title: "Create Simple Evaluator"
method: POST
path: "/preview/simple/evaluators/"
tags: ["Evaluators"]
---

# Create Simple Evaluator

`POST /preview/simple/evaluators/`

## Query parameters

- `evaluator_id` string, uuid, nullable

## Request body

- SimpleEvaluatorCreateRequest
  - `evaluator` SimpleEvaluatorCreate, required
    - `flags` SimpleEvaluatorFlags
      - `is_custom` boolean
      - `is_evaluator` boolean
      - `is_human` boolean
      - `is_chat` boolean
    - `tags` object, nullable
    - `meta` object, nullable
    - `name` string, nullable
    - `description` string, nullable
    - `slug` string, nullable
    - `data` SimpleEvaluatorDataInput
      - `script` object, nullable
      - `parameters` object, nullable
      - `version` string, nullable
      - `uri` string, nullable
      - `url` string, nullable
      - `headers` object, nullable
      - `schemas` JsonSchemasInput
        - `parameters` object, nullable
        - `inputs` object, nullable
        - `outputs` object, nullable
      - `service` object, nullable
      - `configuration` object, nullable

## Response `200`

Successful Response

- SimpleEvaluatorResponse
  - `count` integer
  - `evaluator` SimpleEvaluator
    - `flags` SimpleEvaluatorFlags
      - `is_custom` boolean
      - `is_evaluator` boolean
      - `is_human` boolean
      - `is_chat` boolean
    - `tags` object, nullable
    - `meta` object, nullable
    - `name` string, nullable
    - `description` string, nullable
    - `created_at` string, date-time, nullable
    - `updated_at` string, date-time, nullable
    - `deleted_at` string, date-time, nullable
    - `created_by_id` string, uuid, nullable
    - `updated_by_id` string, uuid, nullable
    - `deleted_by_id` string, uuid, nullable
    - `slug` string, nullable
    - `id` string, uuid, nullable
    - `data` SimpleEvaluatorDataOutput
      - `script` object, nullable
      - `parameters` object, nullable
      - `version` string, nullable
      - `uri` string, nullable
      - `url` string, nullable
      - `headers` object, nullable
      - `schemas` JsonSchemasOutput
        - `parameters` object, nullable
        - `inputs` object, nullable
        - `outputs` object, nullable
      - `service` object, nullable
      - `configuration` object, nullable
    - `variant_id` string, uuid, nullable
    - `revision_id` string, uuid, nullable

## Other responses

- `422` — Validation Error

## Changes

- **2026-02-13** `72fe88316d15` — 1 breaking, 2 warning, 11 info
  - removed `subschema #1` from the `evaluator/data/anyOf[subschema #1: SimpleEvaluatorData]/schemas` request property `anyOf` list
  - removed the request property `evaluator/data/anyOf[subschema #1: SimpleEvaluatorData]/runtime`
  - removed the optional property `evaluator/anyOf[subschema #1: SimpleEvaluator]/data/anyOf[subschema #1: SimpleEvaluatorData]/runtime` from the response with the `200` status
  - added the new optional request property `evaluator/flags/anyOf[subschema #1: SimpleEvaluatorFlags]/is_chat`
  - …10 more
- **2026-01-14** `53da4c9de2b7` — 9 breaking, 2 warning, 15 info
  - removed `#/components/schemas/oss__src__core__shared__dtos__Reference` from the `evaluator/data/anyOf[subschema #1: SimpleEvaluatorData]/headers/anyOf[subschema #1]/additionalProperties/` request property `anyOf` list
  - request property `evaluator/data/anyOf[subschema #1: SimpleEvaluatorData]/script` list-of-types was narrowed by removing types `string` from media type `application/json`
  - request property `evaluator/flags/anyOf[subschema #1: SimpleEvaluatorFlags]/is_custom` list-of-types was narrowed by removing types `null` from media type `application/json`
  - request property `evaluator/flags/anyOf[subschema #1: SimpleEvaluatorFlags]/is_evaluator` list-of-types was narrowed by removing types `null` from media type `application/json`
  - …22 more
- **2025-11-05** `e62506c24377` — 1 info
  - endpoint added

[Change history](https://skmtc.dev/agenta-ai/apis/agenta-api/changes/preview/simple/evaluators/post.md)

---

[API](https://skmtc.dev/agenta-ai/apis/agenta-api.md) · [All operations](https://skmtc.dev/agenta-ai/apis/agenta-api/llms.txt) · [OpenAPI document](https://skmtc-service-production.skmtc.workers.dev/v1/apis/agenta-ai/agenta-api/revisions/42bb75a1c2e6/schema)