---
title: "Changes to Create Eval"
method: POST
path: "/eval"
---

# Changes to Create Eval

`POST /eval`

> Every recorded change to this endpoint, newest first.
> 57 revisions in range; 2 not diffed, 9 could not be searched.

## Timeline

Changed in 10 of 57 revisions.

- **2026-01-06** `57c22d5b3510` — 3 warning, 3 info
- **2025-12-16** `45678bc2c663` — 45 warning
- **2025-11-17** `43f0c6f3dcfb` — 6 warning
- **2025-11-12** `acbf00c4a7f9` — 1 breaking, 1 info
- **2025-10-16** `8474b743bad6` — 1 breaking, 1 warning, 2 info
- **2025-10-13** `2b9e82960b2b` — 2 breaking, 1 warning
- **2025-10-03** `61bab830871d` — 1 breaking
- **2025-10-03** `b66bf0e7c5d0` — 1 warning
- **2025-09-17** `61bab830871d` — 4 breaking
- **2025-09-07** `ee300291d26b` — 1 info

## Changes

- **2026-01-06** `57c22d5b3510` — 3 warning, 3 info
  - added the new `gemini-3-flash-preview` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[#/components/schemas/AssistantMessageJudgePlanAI]/model/oneOf[subschema #3: EvalGoogleModel]/model` response property for the response status `201`
  - added the new `gemini-3-flash-preview` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #3: EvalGoogleModel]/model` response property for the response status `201`
  - added the new `gemini-3-flash-preview` enum value to the `messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #3: EvalGoogleModel]/model` response property for the response status `201`
  - added the new `gemini-3-flash-preview` enum value to the request property `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[#/components/schemas/AssistantMessageJudgePlanAI]/model/oneOf[subschema #3: EvalGoogleModel]/model`
  - added the new `gemini-3-flash-preview` enum value to the request property `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #3: EvalGoogleModel]/model`
  - added the new `gemini-3-flash-preview` enum value to the request property `messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #3: EvalGoogleModel]/model`
- **2025-12-16** `45678bc2c663` — 45 warning
  - added the new `gpt-4.1-2025-04-14:germanywestcentral` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[#/components/schemas/AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4.1-2025-04-14:germanywestcentral` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4.1-2025-04-14:germanywestcentral` enum value to the `messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4.1-2025-04-14:polandcentral` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[#/components/schemas/AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4.1-2025-04-14:polandcentral` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4.1-2025-04-14:polandcentral` enum value to the `messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4.1-2025-04-14:spaincentral` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[#/components/schemas/AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4.1-2025-04-14:spaincentral` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4.1-2025-04-14:spaincentral` enum value to the `messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4.1-2025-04-14:westeurope` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[#/components/schemas/AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4.1-2025-04-14:westeurope` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4.1-2025-04-14:westeurope` enum value to the `messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4.1-mini-2025-04-14:germanywestcentral` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[#/components/schemas/AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4.1-mini-2025-04-14:germanywestcentral` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4.1-mini-2025-04-14:germanywestcentral` enum value to the `messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4.1-mini-2025-04-14:polandcentral` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[#/components/schemas/AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4.1-mini-2025-04-14:polandcentral` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4.1-mini-2025-04-14:polandcentral` enum value to the `messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4.1-mini-2025-04-14:spaincentral` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[#/components/schemas/AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4.1-mini-2025-04-14:spaincentral` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4.1-mini-2025-04-14:spaincentral` enum value to the `messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4.1-mini-2025-04-14:westeurope` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[#/components/schemas/AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4.1-mini-2025-04-14:westeurope` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4.1-mini-2025-04-14:westeurope` enum value to the `messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4o-2024-11-20:germanywestcentral` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[#/components/schemas/AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4o-2024-11-20:germanywestcentral` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4o-2024-11-20:germanywestcentral` enum value to the `messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4o-2024-11-20:polandcentral` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[#/components/schemas/AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4o-2024-11-20:polandcentral` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4o-2024-11-20:polandcentral` enum value to the `messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4o-2024-11-20:spaincentral` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[#/components/schemas/AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4o-2024-11-20:spaincentral` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4o-2024-11-20:spaincentral` enum value to the `messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4o-2024-11-20:westeurope` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[#/components/schemas/AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4o-2024-11-20:westeurope` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-4o-2024-11-20:westeurope` enum value to the `messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-5-chat-latest` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[#/components/schemas/AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-5-chat-latest` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-5-chat-latest` enum value to the `messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-5.2` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[#/components/schemas/AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - …5 more
  - …this revision’s changelog is incomplete
- **2025-11-17** `43f0c6f3dcfb` — 6 warning
  - added the new `gpt-5.1` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[#/components/schemas/AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-5.1` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-5.1` enum value to the `messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-5.1-chat-latest` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[#/components/schemas/AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-5.1-chat-latest` enum value to the `messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - added the new `gpt-5.1-chat-latest` enum value to the `messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model` response property for the response status `201`
  - …this revision’s changelog is incomplete
- **2025-11-12** `acbf00c4a7f9` — 1 breaking, 1 info
  - added `#/components/schemas/ChatEvalToolResponseMessageEvaluation` to the `messages/items/` response property `oneOf` list for the response status `201`
  - added `#/components/schemas/ChatEvalToolResponseMessageEvaluation` to the `messages/items/` request property `oneOf` list
- **2025-10-16** `8474b743bad6` — 1 breaking, 1 warning, 2 info
  - the `description` response property's minLength was decreased from `1` to `0` for the response status `201`
  - added the new `claude-haiku-4-5-20251001` enum value to the `messages/items/oneOf[subschema #5: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #2: EvalAnthropicModel]/model` response property for the response status `201`
  - added the new `claude-haiku-4-5-20251001` enum value to the request property `messages/items/oneOf[subschema #5: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #2: EvalAnthropicModel]/model`
  - the `description` request property's minLength was decreased from `1` to `0`
- **2025-10-13** `2b9e82960b2b` — 2 breaking, 1 warning
  - the `messages/items/oneOf[subschema #2: ChatEvalSystemMessageMock]/content` response property's maxLength was unset from `100000000` for the response status `201`
  - the `messages/items/oneOf[subschema #3: ChatEvalToolResponseMessageMock]/content` response property's maxLength was unset from `1000` for the response status `201`
  - added the new `claude-sonnet-4-5-20250929` enum value to the `messages/items/oneOf[subschema #5: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #2: EvalAnthropicModel]/model` response property for the response status `201`
  - …this revision’s changelog is incomplete
- **2025-10-03** `61bab830871d` — 1 breaking
  - removed the enum value `claude-sonnet-4-5-20250929` of the request property `messages/items/oneOf[subschema #5: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #2: EvalAnthropicModel]/model`
  - …this revision’s changelog is incomplete
- **2025-10-03** `b66bf0e7c5d0` — 1 warning
  - added the new `claude-sonnet-4-5-20250929` enum value to the `messages/items/oneOf[subschema #5: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #2: EvalAnthropicModel]/model` response property for the response status `201`
  - …this revision’s changelog is incomplete
- **2025-09-17** `61bab830871d` — 4 breaking
  - added the new required request property `messages`
  - added the new required request property `type`
  - removed `#/components/schemas/CreateEvalDTO` from the request body `oneOf` list
  - the request's body type/format changed from ``/`` to `object`/``
  - …this revision’s changelog is incomplete
- **2025-09-07** `ee300291d26b` — 1 info
  - endpoint added

---

[Operation](https://skmtc.dev/vapiai/apis/vapi-api/docs/eval/post.md) · [API](https://skmtc.dev/vapiai/apis/vapi-api.md) · [Page](https://skmtc.dev/vapiai/apis/vapi-api/changes/eval/post)