---
title: "Changes to Create Eval"
method: POST
path: "/v2/evals"
---

# Changes to Create Eval

`POST /v2/evals`

> Every recorded change to this endpoint, newest first.

## Timeline

Changed in 11 of 25 revisions.

- **2025-11-20** `0cb64ef11adf` — 2 breaking, 2 warning
- **2025-11-19** `cd49adceebf8` — 1 breaking, 3 info
- **2025-11-19** `0b43b7bedf32` — 4 info
- **2025-11-17** `1af31c95d91a` — 2 breaking, 4 info
- **2025-11-16** `d950d722e230` — 1 breaking, 3 info
- **2025-11-04** `33b4b8e9d2ce` — 1 breaking, 3 info
- **2025-11-03** `b824d75fc3cb` — 2 info
- **2025-10-29** `9b529d67a7d0` — 10 warning, 5 info
- **2025-05-06** `39873621da54` — 2 breaking, 4 info
- **2025-05-05** `13afcad941fd` — 2 breaking, 2 info
- **2025-04-21** `934bf6ad4a6b` — 2 info

## Changes

- **2025-11-20** `0cb64ef11adf` — 2 breaking, 2 warning
  - removed the required property `ai_instructions/anyOf[subschema #2: AgentInstructions]/tools/oneOf[subschema #1: ToolArray]/value/items/id` from the response with the `201` status
  - removed the required property `ai_instructions/anyOf[subschema #3: WorkflowInstructions]/instructions/items/tools/oneOf[subschema #1: ToolArray]/value/items/id` from the response with the `201` status
  - removed the request property `ai_instructions/anyOf[subschema #2: AgentInstructions]/tools/oneOf[subschema #1: ToolArray]/value/items/id`
  - removed the request property `ai_instructions/anyOf[subschema #3: WorkflowInstructions]/instructions/items/tools/oneOf[subschema #1: ToolArray]/value/items/id`
- **2025-11-19** `cd49adceebf8` — 1 breaking, 3 info
  - removed `subschema #1, subschema #4` from the `ai_instructions` request property `anyOf` list
  - added `subschema #1, subschema #4` to the `ai_instructions` request property `anyOf` list
  - added `subschema #1, subschema #4` to the `ai_instructions` response property `anyOf` list for the response status `201`
  - removed `subschema #1, subschema #4` from the `ai_instructions` response property `anyOf` list for the response status `201`
- **2025-11-19** `0b43b7bedf32` — 4 info
  - added the new optional request property `ai_instructions/anyOf[subschema #2: AgentInstructions]/agent_name`
  - added `#/components/schemas/WorkflowInstructions` to the `ai_instructions` request property `anyOf` list
  - added the optional property `ai_instructions/anyOf[subschema #2: AgentInstructions]/agent_name` to the response with the `201` status
  - added `#/components/schemas/WorkflowInstructions` to the `ai_instructions` response property `anyOf` list for the response status `201`
- **2025-11-17** `1af31c95d91a` — 2 breaking, 4 info
  - removed `#/components/schemas/ToolsList, #/components/schemas/ToolDict, #/components/schemas/ToolsString` from the `ai_instructions/anyOf[subschema #2: AgentInstructions]/tools` request property `anyOf` list
  - added `#/components/schemas/ToolArray, #/components/schemas/ToolDict, #/components/schemas/ToolString` to the `ai_instructions/anyOf[subschema #2: AgentInstructions]/tools` response property `oneOf` list for the response status `201`
  - added discriminator to `ai_instructions/anyOf[subschema #2: AgentInstructions]/tools` request property
  - added `#/components/schemas/ToolArray, #/components/schemas/ToolDict, #/components/schemas/ToolString` to the `ai_instructions/anyOf[subschema #2: AgentInstructions]/tools` request property `oneOf` list
  - removed `#/components/schemas/ToolsList, #/components/schemas/ToolDict, #/components/schemas/ToolsString` from the `ai_instructions/anyOf[subschema #2: AgentInstructions]/tools` response property `anyOf` list for the response status `201`
  - added discriminator to `ai_instructions/anyOf[subschema #2: AgentInstructions]/tools` response property for the response status `201`
- **2025-11-16** `d950d722e230` — 1 breaking, 3 info
  - removed `subschema #1, subschema #3` from the `ai_instructions/anyOf[subschema #2: AgentInstructions]/tools` request property `anyOf` list
  - added `subschema #1, subschema #3` to the `ai_instructions/anyOf[subschema #2: AgentInstructions]/tools` request property `anyOf` list
  - added `subschema #1, subschema #3` to the `ai_instructions/anyOf[subschema #2: AgentInstructions]/tools` response property `anyOf` list for the response status `201`
  - removed `subschema #1, subschema #3` from the `ai_instructions/anyOf[subschema #2: AgentInstructions]/tools` response property `anyOf` list for the response status `201`
- **2025-11-04** `33b4b8e9d2ce` — 1 breaking, 3 info
  - removed `subschema #2` from the `ai_instructions/anyOf[subschema #2: AgentInstructions]/tools` request property `anyOf` list
  - added `subschema #1` to the `ai_instructions/anyOf[subschema #2: AgentInstructions]/tools` request property `anyOf` list
  - added `subschema #1` to the `ai_instructions/anyOf[subschema #2: AgentInstructions]/tools` response property `anyOf` list for the response status `201`
  - removed `subschema #2` from the `ai_instructions/anyOf[subschema #2: AgentInstructions]/tools` response property `anyOf` list for the response status `201`
- **2025-11-03** `b824d75fc3cb` — 2 info
  - added `#/components/schemas/AgentInstructions` to the `ai_instructions` request property `anyOf` list
  - added `#/components/schemas/AgentInstructions` to the `ai_instructions` response property `anyOf` list for the response status `201`
- **2025-10-29** `9b529d67a7d0` — 10 warning, 5 info
  - added the new `auth.workspace_required` enum value to the `error/code` response property for the response status `400`
  - added the new `auth.workspace_required` enum value to the `error/code` response property for the response status `401`
  - added the new `auth.workspace_required` enum value to the `error/code` response property for the response status `403`
  - added the new `auth.workspace_required` enum value to the `error/code` response property for the response status `404`
  - added the new `auth.workspace_required` enum value to the `error/code` response property for the response status `409`
  - added the new `auth.workspace_required` enum value to the `error/code` response property for the response status `422`
  - added the new `auth.workspace_required` enum value to the `error/code` response property for the response status `429`
  - added the new `auth.workspace_required` enum value to the `error/code` response property for the response status `500`
  - added the new `auth.workspace_required` enum value to the `error/code` response property for the response status `503`
  - added the new `video` enum value to the `modality/allOf[subschema #1: ContentType]/` response property for the response status `201`
  - added the new optional request property `created_by`
  - added the new optional request property `ground_truth/anyOf[subschema #2: FileReference]/file_uuid`
  - added the new `video` enum value to the request property `modality/allOf[subschema #1: ContentType]/`
  - added the optional property `created_by` to the response with the `201` status
  - added the optional property `ground_truth/anyOf[subschema #2: FileReference]/file_uuid` to the response with the `201` status
- **2025-05-06** `39873621da54` — 2 breaking, 4 info
  - removed the enum value `audio` of the request property `modality/allOf[subschema #1: ContentType]/`
  - removed the enum value `video` of the request property `modality/allOf[subschema #1: ContentType]/`
  - the `num_prompts` request property default value changed from `50` to `100`
  - the `num_prompts` response's property default value changed from `50` to `100` for the status `201`
  - removed the `audio` enum value from the `modality/allOf[subschema #1: ContentType]/` response property for the response status `201`
  - removed the `video` enum value from the `modality/allOf[subschema #1: ContentType]/` response property for the response status `201`
- **2025-05-05** `13afcad941fd` — 2 breaking, 2 info
  - the response property `name` became optional for the status `201`
  - response property `name` list-of-types was widened by adding types `null` to media type `application/json` of response `201`
  - the request property `name` became optional
  - request property `name` list-of-types was widened by adding types `null` to media type `application/json`
- **2025-04-21** `934bf6ad4a6b` — 2 info
  - added the new optional request property `ground_truth`
  - added the optional property `ground_truth` to the response with the `201` status

---

[Operation](https://skmtc.dev/aymara-ai/apis/aymara-api/docs/v2/evals/post.md) · [API](https://skmtc.dev/aymara-ai/apis/aymara-api.md) · [Page](https://skmtc.dev/aymara-ai/apis/aymara-api/changes/v2/evals/post)