--- title: "Changes to Create eval run" method: POST path: "/evals/{eval_id}/runs" --- # Changes to Create eval run `POST /evals/{eval_id}/runs` > Every recorded change to this operation, newest first. ## Timeline Changed in 25 of 397 revisions. - **2026-10-26** `6f5c52c2ff04`: 14 info - **2026-10-23** `f1af3e12b410`: 2 info - **2026-10-06** `e2f8d8cbc41f`: 4 info - **2026-09-29** `5bc613d74aef`: 7 breaking, 1 info - **2026-09-28** `17f4bc11b90f`: 2 breaking, 2 info - **2026-09-25** `d86203de41ae`: 4 breaking, 1 warning, 3 info - **2026-09-16** `2cd8933757a4`: 2 info - **2026-09-08** `bb9b3b410112`: 8 warning, 20 info - **2026-09-08** `185927e212ab`: 6 warning, 6 info - **2026-09-03** `9430b00d75b4`: 10 info - **2026-08-20** `5de4ab93fa24`: 2 warning, 2 info - **2026-08-14** `6ac2618eefd7`: 1 info - **2026-08-13** `fc45a2f64c0a`: 2 info - **2026-08-05** `ab0c5306e390`: 2 breaking, 4 warning, 42 info - **2026-08-04** `4d5ff0000988`: 1 breaking, 1 info - **2026-07-15** `4065aec90c5d`: 1 breaking, 4 warning, 41 info - **2026-07-09** `e0508a503b84`: 4 warning, 40 info - **2026-06-17** `827fa3e74ce9`: 2 info - **2026-05-13** `74cbcf73838f`: 42 breaking, 6 warning, 52 info - **2026-05-07** `737fbb7f6f17`: 4 breaking, 3 warning, 7 info - **2026-05-06** `1b5c6501b847`: 2 breaking, 2 info - **2026-05-04** `64494d56c425`: 2 breaking - **2026-04-29** `5b98524f8dee`: 5 breaking - **2026-04-10** `7c540cce6eb3`: 5 breaking, 5 info - **2025-04-29** `6a6c681b1820`: 1 info ## Changes - **2026-10-26** `6f5c52c2ff04`: 14 info - added the new optional request property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #1: Input message]/content/oneOf[subschema #2: Input item content list]/items/oneOf[subschema #1: Input text]/prompt_cache_breakpoint/ttl` - added the new optional request property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #1: Input message]/content/oneOf[subschema #2: Input item content list]/items/oneOf[subschema #2: Input image]/prompt_cache_breakpoint/ttl` - added the new optional request property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #1: Input message]/content/oneOf[subschema #2: Input item content list]/items/oneOf[subschema #3: Input file]/prompt_cache_breakpoint/ttl` - added the new optional request property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #2: Eval message object]/content/oneOf[subschema #1: Eval content item]/oneOf[subschema #2: Input text]/prompt_cache_breakpoint/ttl` - added the new optional request property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #2: Eval message object]/content/oneOf[subschema #2: An array of Input text, Output text, Input image, and Input audio]/items/oneOf[subschema #2: Input text]/prompt_cache_breakpoint/ttl` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/input_messages/oneOf[subschema #1: InputMessagesTemplate]/template/items/oneOf[subschema #2: Eval message object]/content/oneOf[subschema #1: Eval content item]/oneOf[subschema #2: Input text]/prompt_cache_breakpoint/ttl` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/input_messages/oneOf[subschema #1: InputMessagesTemplate]/template/items/oneOf[subschema #2: Eval message object]/content/oneOf[subschema #2: An array of Input text, Output text, Input image, and Input audio]/items/oneOf[subschema #2: Input text]/prompt_cache_breakpoint/ttl` - added the optional property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #1: Input message]/content/oneOf[subschema #2: Input item content list]/items/oneOf[subschema #1: Input text]/prompt_cache_breakpoint/ttl` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #1: Input message]/content/oneOf[subschema #2: Input item content list]/items/oneOf[subschema #2: Input image]/prompt_cache_breakpoint/ttl` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #1: Input message]/content/oneOf[subschema #2: Input item content list]/items/oneOf[subschema #3: Input file]/prompt_cache_breakpoint/ttl` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #2: Eval message object]/content/oneOf[subschema #1: Eval content item]/oneOf[subschema #2: Input text]/prompt_cache_breakpoint/ttl` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #2: Eval message object]/content/oneOf[subschema #2: An array of Input text, Output text, Input image, and Input audio]/items/oneOf[subschema #2: Input text]/prompt_cache_breakpoint/ttl` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/input_messages/oneOf[subschema #1: InputMessagesTemplate]/template/items/oneOf[subschema #2: Eval message object]/content/oneOf[subschema #1: Eval content item]/oneOf[subschema #2: Input text]/prompt_cache_breakpoint/ttl` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/input_messages/oneOf[subschema #1: InputMessagesTemplate]/template/items/oneOf[subschema #2: Eval message object]/content/oneOf[subschema #2: An array of Input text, Output text, Input image, and Input audio]/items/oneOf[subschema #2: Input text]/prompt_cache_breakpoint/ttl` to the response with the `201` status - **2026-10-23** `f1af3e12b410`: 2 info - the `` request property default value changed from `gpt-image-1` to `gpt-image-2` - the `` response's property default value changed from `gpt-image-1` to `gpt-image-2` for the status `201` - **2026-10-06** `e2f8d8cbc41f`: 4 info - added the optional property `error/misalignment/review_target` to the response with the `400` status - added the optional property `error/misalignment/review_target` to the response with the `404` status - added the optional property `error/misalignment/review_target` to the response with the `429` status - added the optional property `error/misalignment/review_target` to the response with the `500` status - **2026-09-29** `5bc613d74aef`: 7 breaking, 1 info - the response property `model` became nullable for the status `201` - the response property `name` became nullable for the status `201` - the response property `per_model_usage` became nullable for the status `201` - the response property `per_testing_criteria_results` became nullable for the status `201` - the `error` response's property type changed from `object` to no type for status `201` - removed the required property `error/code` from the response with the `201` status - removed the required property `error/message` from the response with the `201` status - added `#/components/schemas/EvalApiError, subschema #2` to the `error` response property `anyOf` list for the response status `201` - **2026-09-28** `17f4bc11b90f`: 2 breaking, 2 info - removed `subschema #2` from the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #2: File search]/filters/anyOf[#/components/schemas/Filters]/anyOf[subschema #2: Compound Filter]/filters/items/` request property `oneOf` list - added `#/components/schemas/CompoundFilter` to the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #2: File search]/filters/anyOf[#/components/schemas/Filters]/anyOf[subschema #2: Compound Filter]/filters/items/` response property `oneOf` list for the response status `201` - added `#/components/schemas/CompoundFilter` to the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #2: File search]/filters/anyOf[#/components/schemas/Filters]/anyOf[subschema #2: Compound Filter]/filters/items/` request property `oneOf` list - removed `subschema #2` from the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #2: File search]/filters/anyOf[#/components/schemas/Filters]/anyOf[subschema #2: Compound Filter]/filters/items/` response property `oneOf` list for the response status `201` - **2026-09-25** `d86203de41ae`: 4 breaking, 1 warning, 3 info - removed the required property `code` from the response with the `400` status - removed the required property `message` from the response with the `400` status - removed the required property `param` from the response with the `400` status - removed the required property `type` from the response with the `400` status - removed the optional property `misalignment` from the response with the `400` status - added the non-success response with the status `404` - added the non-success response with the status `500` - added the required property `error` to the response with the `400` status - **2026-09-16** `2cd8933757a4`: 2 info - request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #6: MCP tool]/connector_id` deprecated - response property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #6: MCP tool]/connector_id` deprecated - **2026-09-08** `bb9b3b410112`: 8 warning, 20 info - added the new `gpt-image-2` enum value to the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/model/anyOf[subschema #2]/` response property for the response status `201` - added the new `gpt-image-2-2026-04-21` enum value to the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/model/anyOf[subschema #2]/` response property for the response status `201` - added the new `gpt-image-2.5-flare` enum value to the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/model/anyOf[subschema #2]/` response property for the response status `201` - added the new `gpt-image-2.5-flare-2026-09-08` enum value to the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/model/anyOf[subschema #2]/` response property for the response status `201` - added the new `gpt-image-2.5-sunburst` enum value to the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/model/anyOf[subschema #2]/` response property for the response status `201` - added the new `gpt-image-2.5-sunburst-2026-09-08` enum value to the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/model/anyOf[subschema #2]/` response property for the response status `201` - added the new `max` enum value to the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/quality` response property for the response status `201` - added the new `xhigh` enum value to the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/quality` response property for the response status `201` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #12: Custom tool]/async` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #13: Namespace]/tools/items/oneOf[#/components/schemas/FunctionToolParam]/async` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #13: Namespace]/tools/items/oneOf[subschema #2: Custom tool]/async` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #1: Function]/async` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #5: Web search]/external_web_access` - added the new `gpt-image-2` enum value to the request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/model/anyOf[subschema #2]/` - added the new `gpt-image-2-2026-04-21` enum value to the request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/model/anyOf[subschema #2]/` - added the new `gpt-image-2.5-flare` enum value to the request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/model/anyOf[subschema #2]/` - added the new `gpt-image-2.5-flare-2026-09-08` enum value to the request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/model/anyOf[subschema #2]/` - added the new `gpt-image-2.5-sunburst` enum value to the request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/model/anyOf[subschema #2]/` - added the new `gpt-image-2.5-sunburst-2026-09-08` enum value to the request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/model/anyOf[subschema #2]/` - added the new `max` enum value to the request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/quality` - added the new `xhigh` enum value to the request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/quality` - added the non-success response with the status `429` - added the optional property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #12: Custom tool]/async` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #13: Namespace]/tools/items/oneOf[#/components/schemas/FunctionToolParam]/async` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #13: Namespace]/tools/items/oneOf[subschema #2: Custom tool]/async` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #1: Function]/async` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #5: Web search]/external_web_access` to the response with the `201` status - added the optional property `misalignment` to the response with the `400` status - **2026-09-08** `185927e212ab`: 6 warning, 6 info - added the new `gpt-image-2.5-flare` enum value to the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/model/anyOf[subschema #2]/` response property for the response status `201` - added the new `gpt-image-2.5-flare-2026-09-08` enum value to the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/model/anyOf[subschema #2]/` response property for the response status `201` - added the new `gpt-image-2.5-sunburst` enum value to the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/model/anyOf[subschema #2]/` response property for the response status `201` - added the new `gpt-image-2.5-sunburst-2026-09-08` enum value to the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/model/anyOf[subschema #2]/` response property for the response status `201` - added the new `max` enum value to the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/quality` response property for the response status `201` - added the new `xhigh` enum value to the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/quality` response property for the response status `201` - added the new `gpt-image-2.5-flare` enum value to the request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/model/anyOf[subschema #2]/` - added the new `gpt-image-2.5-flare-2026-09-08` enum value to the request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/model/anyOf[subschema #2]/` - added the new `gpt-image-2.5-sunburst` enum value to the request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/model/anyOf[subschema #2]/` - added the new `gpt-image-2.5-sunburst-2026-09-08` enum value to the request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/model/anyOf[subschema #2]/` - added the new `max` enum value to the request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/quality` - added the new `xhigh` enum value to the request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/quality` - **2026-09-03** `9430b00d75b4`: 10 info - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #12: Custom tool]/async` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #13: Namespace]/tools/items/oneOf[#/components/schemas/FunctionToolParam]/async` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #13: Namespace]/tools/items/oneOf[subschema #2: Custom tool]/async` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #1: Function]/async` - added the optional property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #12: Custom tool]/async` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #13: Namespace]/tools/items/oneOf[#/components/schemas/FunctionToolParam]/async` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #13: Namespace]/tools/items/oneOf[subschema #2: Custom tool]/async` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #1: Function]/async` to the response with the `201` status - added the optional property `error/misalignment` to the response with the `429` status - added the optional property `misalignment` to the response with the `400` status - **2026-08-20** `5de4ab93fa24`: 2 warning, 2 info - added the new `gpt-image-2` enum value to the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/model/anyOf[subschema #2]/` response property for the response status `201` - added the new `gpt-image-2-2026-04-21` enum value to the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/model/anyOf[subschema #2]/` response property for the response status `201` - added the new `gpt-image-2` enum value to the request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/model/anyOf[subschema #2]/` - added the new `gpt-image-2-2026-04-21` enum value to the request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #9: Image generation tool]/model/anyOf[subschema #2]/` - **2026-08-14** `6ac2618eefd7`: 1 info - added the non-success response with the status `429` - **2026-08-13** `fc45a2f64c0a`: 2 info - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #5: Web search]/external_web_access` - added the optional property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #5: Web search]/external_web_access` to the response with the `201` status - **2026-08-05** `ab0c5306e390`: 2 breaking, 4 warning, 42 info - the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #12: Namespace -> subschema #13: Namespace]/description` response property's minLength was decreased from `1` to `0` for the response status `201` - added `#/components/schemas/ProgrammaticToolCallingParam` to the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/` response property `oneOf` list for the response status `201` - added the new `auto` enum value to the `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #1: Input message]/content/oneOf[subschema #2: Input item content list]/items/oneOf[subschema #3: Input file]/detail` response property for the response status `201` - added the new `max` enum value to the `data_source/oneOf[subschema #2: CompletionsRunDataSource]/sampling_params/reasoning_effort/anyOf[subschema #1]/` response property for the response status `201` - added the new `max` enum value to the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/reasoning_effort/anyOf[subschema #1]/` response property for the response status `201` - added the new `max` enum value to the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/source/oneOf[subschema #3: EvalResponsesSource]/reasoning_effort/anyOf[#/components/schemas/ReasoningEffort]/anyOf[subschema #1]/` response property for the response status `201` - added the new optional request property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #1: Input message]/content/oneOf[subschema #2: Input item content list]/items/oneOf[subschema #1: Input text]/prompt_cache_breakpoint` - added the new optional request property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #1: Input message]/content/oneOf[subschema #2: Input item content list]/items/oneOf[subschema #2: Input image]/prompt_cache_breakpoint` - added the new optional request property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #1: Input message]/content/oneOf[subschema #2: Input item content list]/items/oneOf[subschema #3: Input file]/prompt_cache_breakpoint` - added the new optional request property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #2: Eval message object]/content/oneOf[subschema #1: Eval content item]/oneOf[subschema #2: Input text]/prompt_cache_breakpoint` - added the new optional request property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #2: Eval message object]/content/oneOf[subschema #2: An array of Input text, Output text, Input image, and Input audio]/items/oneOf[subschema #2: Input text]/prompt_cache_breakpoint` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/input_messages/oneOf[subschema #1: InputMessagesTemplate]/template/items/oneOf[subschema #2: Eval message object]/content/oneOf[subschema #1: Eval content item]/oneOf[subschema #2: Input text]/prompt_cache_breakpoint` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/input_messages/oneOf[subschema #1: InputMessagesTemplate]/template/items/oneOf[subschema #2: Eval message object]/content/oneOf[subschema #2: An array of Input text, Output text, Input image, and Input audio]/items/oneOf[subschema #2: Input text]/prompt_cache_breakpoint` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #10: Shell tool -> subschema #11: Shell tool]/allowed_callers` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #11: Custom tool -> subschema #12: Custom tool]/allowed_callers` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #12: Namespace -> subschema #13: Namespace]/tools/items/oneOf[#/components/schemas/FunctionToolParam]/allowed_callers` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #12: Namespace -> subschema #13: Namespace]/tools/items/oneOf[#/components/schemas/FunctionToolParam]/output_schema` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #12: Namespace -> subschema #13: Namespace]/tools/items/oneOf[subschema #2: Custom tool]/allowed_callers` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #15: Apply patch tool -> subschema #16: Apply patch tool]/allowed_callers` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #1: Function]/allowed_callers` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #1: Function]/output_schema` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #6: MCP tool]/allowed_callers` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #6: MCP tool]/tunnel_id` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #7: Code interpreter]/allowed_callers` - added the new `auto` enum value to the request property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #1: Input message]/content/oneOf[subschema #2: Input item content list]/items/oneOf[subschema #3: Input file]/detail` - added the new `max` enum value to the request property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/sampling_params/reasoning_effort/anyOf[subschema #1]/` - added the new `max` enum value to the request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/reasoning_effort/anyOf[subschema #1]/` - added the new `max` enum value to the request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/source/oneOf[subschema #3: EvalResponsesSource]/reasoning_effort/anyOf[#/components/schemas/ReasoningEffort]/anyOf[subschema #1]/` - the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #12: Namespace -> subschema #13: Namespace]/description` request property's minLength was decreased from `1` to `0` - added `#/components/schemas/ProgrammaticToolCallingParam` to the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/` request property `oneOf` list - added the optional property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #1: Input message]/content/oneOf[subschema #2: Input item content list]/items/oneOf[subschema #1: Input text]/prompt_cache_breakpoint` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #1: Input message]/content/oneOf[subschema #2: Input item content list]/items/oneOf[subschema #2: Input image]/prompt_cache_breakpoint` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #1: Input message]/content/oneOf[subschema #2: Input item content list]/items/oneOf[subschema #3: Input file]/prompt_cache_breakpoint` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #2: Eval message object]/content/oneOf[subschema #1: Eval content item]/oneOf[subschema #2: Input text]/prompt_cache_breakpoint` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #2: Eval message object]/content/oneOf[subschema #2: An array of Input text, Output text, Input image, and Input audio]/items/oneOf[subschema #2: Input text]/prompt_cache_breakpoint` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/input_messages/oneOf[subschema #1: InputMessagesTemplate]/template/items/oneOf[subschema #2: Eval message object]/content/oneOf[subschema #1: Eval content item]/oneOf[subschema #2: Input text]/prompt_cache_breakpoint` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/input_messages/oneOf[subschema #1: InputMessagesTemplate]/template/items/oneOf[subschema #2: Eval message object]/content/oneOf[subschema #2: An array of Input text, Output text, Input image, and Input audio]/items/oneOf[subschema #2: Input text]/prompt_cache_breakpoint` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #10: Shell tool -> subschema #11: Shell tool]/allowed_callers` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #11: Custom tool -> subschema #12: Custom tool]/allowed_callers` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #12: Namespace -> subschema #13: Namespace]/tools/items/oneOf[#/components/schemas/FunctionToolParam]/allowed_callers` to the response with the `201` status - …8 more - **2026-08-04** `4d5ff0000988`: 1 breaking, 1 info - the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #13: Namespace]/description` response property's minLength was decreased from `1` to `0` for the response status `201` - the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #13: Namespace]/description` request property's minLength was decreased from `1` to `0` - **2026-07-15** `4065aec90c5d`: 1 breaking, 4 warning, 41 info - added `#/components/schemas/ProgrammaticToolCallingParam` to the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/` response property `oneOf` list for the response status `201` - added the new `auto` enum value to the `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #1: Input message]/content/oneOf[subschema #2: Input item content list]/items/oneOf[subschema #3: Input file]/detail` response property for the response status `201` - added the new `max` enum value to the `data_source/oneOf[subschema #2: CompletionsRunDataSource]/sampling_params/reasoning_effort/anyOf[subschema #1]/` response property for the response status `201` - added the new `max` enum value to the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/reasoning_effort/anyOf[subschema #1]/` response property for the response status `201` - added the new `max` enum value to the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/source/oneOf[subschema #3: EvalResponsesSource]/reasoning_effort/anyOf[#/components/schemas/ReasoningEffort]/anyOf[subschema #1]/` response property for the response status `201` - added the new optional request property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #1: Input message]/content/oneOf[subschema #2: Input item content list]/items/oneOf[subschema #1: Input text]/prompt_cache_breakpoint` - added the new optional request property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #1: Input message]/content/oneOf[subschema #2: Input item content list]/items/oneOf[subschema #2: Input image]/prompt_cache_breakpoint` - added the new optional request property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #1: Input message]/content/oneOf[subschema #2: Input item content list]/items/oneOf[subschema #3: Input file]/prompt_cache_breakpoint` - added the new optional request property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #2: Eval message object]/content/oneOf[subschema #1: Eval content item]/oneOf[subschema #2: Input text]/prompt_cache_breakpoint` - added the new optional request property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #2: Eval message object]/content/oneOf[subschema #2: An array of Input text, Output text, Input image, and Input audio]/items/oneOf[subschema #2: Input text]/prompt_cache_breakpoint` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/input_messages/oneOf[subschema #1: InputMessagesTemplate]/template/items/oneOf[subschema #2: Eval message object]/content/oneOf[subschema #1: Eval content item]/oneOf[subschema #2: Input text]/prompt_cache_breakpoint` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/input_messages/oneOf[subschema #1: InputMessagesTemplate]/template/items/oneOf[subschema #2: Eval message object]/content/oneOf[subschema #2: An array of Input text, Output text, Input image, and Input audio]/items/oneOf[subschema #2: Input text]/prompt_cache_breakpoint` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #10: Shell tool -> subschema #11: Shell tool]/allowed_callers` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #11: Custom tool -> subschema #12: Custom tool]/allowed_callers` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #12: Namespace -> subschema #13: Namespace]/tools/items/oneOf[#/components/schemas/FunctionToolParam]/allowed_callers` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #12: Namespace -> subschema #13: Namespace]/tools/items/oneOf[#/components/schemas/FunctionToolParam]/output_schema` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #12: Namespace -> subschema #13: Namespace]/tools/items/oneOf[subschema #2: Custom tool]/allowed_callers` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #15: Apply patch tool -> subschema #16: Apply patch tool]/allowed_callers` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #1: Function]/allowed_callers` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #1: Function]/output_schema` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #6: MCP tool]/allowed_callers` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #6: MCP tool]/tunnel_id` - added the new optional request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #7: Code interpreter]/allowed_callers` - added the new `auto` enum value to the request property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #1: Input message]/content/oneOf[subschema #2: Input item content list]/items/oneOf[subschema #3: Input file]/detail` - added the new `max` enum value to the request property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/sampling_params/reasoning_effort/anyOf[subschema #1]/` - added the new `max` enum value to the request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/reasoning_effort/anyOf[subschema #1]/` - added the new `max` enum value to the request property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/source/oneOf[subschema #3: EvalResponsesSource]/reasoning_effort/anyOf[#/components/schemas/ReasoningEffort]/anyOf[subschema #1]/` - added `#/components/schemas/ProgrammaticToolCallingParam` to the `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/` request property `oneOf` list - added the optional property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #1: Input message]/content/oneOf[subschema #2: Input item content list]/items/oneOf[subschema #1: Input text]/prompt_cache_breakpoint` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #1: Input message]/content/oneOf[subschema #2: Input item content list]/items/oneOf[subschema #2: Input image]/prompt_cache_breakpoint` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #1: Input message]/content/oneOf[subschema #2: Input item content list]/items/oneOf[subschema #3: Input file]/prompt_cache_breakpoint` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #2: Eval message object]/content/oneOf[subschema #1: Eval content item]/oneOf[subschema #2: Input text]/prompt_cache_breakpoint` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #2: CompletionsRunDataSource]/input_messages/oneOf[subschema #1: TemplateInputMessages]/template/items/oneOf[subschema #2: Eval message object]/content/oneOf[subschema #2: An array of Input text, Output text, Input image, and Input audio]/items/oneOf[subschema #2: Input text]/prompt_cache_breakpoint` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/input_messages/oneOf[subschema #1: InputMessagesTemplate]/template/items/oneOf[subschema #2: Eval message object]/content/oneOf[subschema #1: Eval content item]/oneOf[subschema #2: Input text]/prompt_cache_breakpoint` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/input_messages/oneOf[subschema #1: InputMessagesTemplate]/template/items/oneOf[subschema #2: Eval message object]/content/oneOf[subschema #2: An array of Input text, Output text, Input image, and Input audio]/items/oneOf[subschema #2: Input text]/prompt_cache_breakpoint` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #10: Shell tool -> subschema #11: Shell tool]/allowed_callers` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #11: Custom tool -> subschema #12: Custom tool]/allowed_callers` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #12: Namespace -> subschema #13: Namespace]/tools/items/oneOf[#/components/schemas/FunctionToolParam]/allowed_callers` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #12: Namespace -> subschema #13: Namespace]/tools/items/oneOf[#/components/schemas/FunctionToolParam]/output_schema` to the response with the `201` status - added the optional property `data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #12: Namespace -> subschema #13: Namespace]/tools/items/oneOf[subschema #2: Custom tool]/allowed_callers` to the response with the `201` status - …6 more - …earlier changes are on the page: https://skmtc.dev/openai/apis/openapi/changes/evals/:eval_id/runs/post --- [Operation](https://skmtc.dev/openai/apis/openapi/docs/evals/:eval_id/runs/post.md) - [API](https://skmtc.dev/openai/apis/openapi.md) - [Page](https://skmtc.dev/openai/apis/openapi/changes/evals/:eval_id/runs/post)