---
title: "Create Simple Evaluator"
method: POST
path: "/simple/evaluators/"
tags: ["Evaluators"]
---

# Create Simple Evaluator

`POST /simple/evaluators/`

## Query parameters

- `evaluator_id` string, uuid, nullable

## Request body

- SimpleEvaluatorCreateRequest
  - `evaluator` SimpleEvaluatorCreate, required
    - `flags` SimpleEvaluatorFlags
      - `is_application` boolean
      - `is_evaluator` boolean
      - `is_snippet` boolean
      - `is_managed` boolean
      - `is_custom` boolean
      - `is_llm` boolean
      - `is_hook` boolean
      - `is_code` boolean
      - `is_match` boolean
      - `is_feedback` boolean
      - `is_chat` boolean
      - `has_url` boolean
      - `has_script` boolean
      - `has_handler` boolean
    - `tags` object, nullable
    - `meta` object, nullable
    - `name` string, nullable
    - `description` string, nullable
    - `slug` string, nullable
    - `data` SimpleEvaluatorDataInput
      - `uri` string, nullable
      - `url` string, nullable
      - `headers` object, nullable
      - `runtime` 'python' | 'typescript' | 'javascript', nullable
      - `script` string, nullable
      - `schemas` JsonSchemasInput
        - `parameters` object, nullable
        - `inputs` object, nullable
        - `outputs` object, nullable
      - `parameters` object, nullable

## Response `200`

Successful Response

- SimpleEvaluatorResponse
  - `count` integer
  - `evaluator` SimpleEvaluator
    - `flags` SimpleEvaluatorFlags
      - `is_application` boolean
      - `is_evaluator` boolean
      - `is_snippet` boolean
      - `is_managed` boolean
      - `is_custom` boolean
      - `is_llm` boolean
      - `is_hook` boolean
      - `is_code` boolean
      - `is_match` boolean
      - `is_feedback` boolean
      - `is_chat` boolean
      - `has_url` boolean
      - `has_script` boolean
      - `has_handler` boolean
    - `tags` object, nullable
    - `meta` object, nullable
    - `name` string, nullable
    - `description` string, nullable
    - `created_at` string, date-time, nullable
    - `updated_at` string, date-time, nullable
    - `deleted_at` string, date-time, nullable
    - `created_by_id` string, uuid, nullable
    - `updated_by_id` string, uuid, nullable
    - `deleted_by_id` string, uuid, nullable
    - `slug` string, nullable
    - `id` string, uuid, nullable
    - `data` SimpleEvaluatorDataOutput
      - `uri` string, nullable
      - `url` string, nullable
      - `headers` object, nullable
      - `runtime` 'python' | 'typescript' | 'javascript', nullable
      - `script` string, nullable
      - `schemas` JsonSchemasOutput
        - `parameters` object, nullable
        - `inputs` object, nullable
        - `outputs` object, nullable
      - `parameters` object, nullable
    - `variant_id` string, uuid, nullable
    - `revision_id` string, uuid, nullable

## Other responses

- `422` — Validation Error

## Changes

- **2026-04-16** `8b06b786c977` — 4 breaking, 8 warning, 24 info
  - request property `evaluator/data/anyOf[subschema #1: SimpleEvaluatorData]/script` list-of-types was narrowed by removing types `object` from media type `application/json`
  - the `evaluator/data/anyOf[subschema #1: SimpleEvaluatorData]/script/anyOf[subschema #1]/` request property type/format changed from `object`/`` to `string`/``
  - response property `evaluator/anyOf[subschema #1: SimpleEvaluator]/data/anyOf[subschema #1: SimpleEvaluatorData]/script` list-of-types was widened by adding types `string` to media type `application/json` of response `200`
  - the `evaluator/anyOf[subschema #1: SimpleEvaluator]/data/anyOf[subschema #1: SimpleEvaluatorData]/script/anyOf[subschema #1]/` response's property type/format changed from `object`/`` to `string`/`` for status `200`
  - …32 more
- **2026-02-27** `8fcd55a5a656` — 1 info
  - endpoint added
- **2025-06-27** `e3e84db47198` — 1 breaking
  - api path removed without deprecation

[Change history](https://skmtc.dev/agenta-ai/apis/agenta-api/changes/simple/evaluators/post.md)

---

[API](https://skmtc.dev/agenta-ai/apis/agenta-api.md) · [All operations](https://skmtc.dev/agenta-ai/apis/agenta-api/llms.txt) · [OpenAPI document](https://skmtc-service-production.skmtc.workers.dev/v1/apis/agenta-ai/agenta-api/revisions/c469c2f6cdba/schema)