--- title: "Changes to Launch an eval" method: POST path: "/v1/eval" --- # Changes to Launch an eval `POST /v1/eval` > Every recorded change to this operation, newest first. ## Timeline Changed in 28 of 101 revisions. - **2026-10-30** `8f5039399f77`: 162 breaking - **2026-10-29** `6409b3f2bde5`: 1 info - **2026-10-03** `877ab1fd2a22`: 4 info - **2026-09-22** `2e0e9e00d0bd`: 4 info - **2026-08-21** `2ddd4c0bfd2c`: 5 info - **2026-08-13** `e05ef145579d`: 41 info - **2026-05-21** `7c3461755f69`: 4 info - **2026-04-25** `d51a7016439c`: 4 info - **2026-04-08** `a21b724fece9`: 2 info - **2026-03-04** `79e3efbd784c`: 16 info - **2026-02-10** `4918f9bd942e`: 14 info - **2026-02-02** `8dda984bb502`: 8 breaking - **2026-01-23** `79b5f945907c`: 32 info - **2026-01-13** `97c5791b3df1`: 6 breaking, 10 info - **2026-01-08** `c7496daaaa37`: 20 info - **2025-12-04** `b6967d956e2f`: 19 info - **2025-11-18** `ae80b8fa951b`: 32 info - **2025-09-29** `167acf59c7c3`: 8 info - **2025-08-15** `a3fce07a60cf`: 8 breaking, 3 info - **2025-08-07** `7b003086a539`: 8 info - **2025-07-16** `87d9da616538`: 4 info - **2025-07-16** `29c3853d6db5`: 4 info - **2025-06-17** `77a2d5797d94`: 6 breaking, 2 warning, 32 info - **2024-09-30** `ac2727014d93`: 3 breaking, 4 info - **2024-09-25** `68955d9009ff`: 2 breaking - **2024-09-24** `a774951c03d7`: 2 breaking, 2 info - **2024-09-21** `1e677afe2f7b`: 2 info - **2024-07-30** `9635568dd298`: 1 info ## Changes - **2026-10-30** `8f5039399f77`: 162 breaking - the request property `base_experiment_id` became not nullable - the request property `base_experiment_name` became not nullable - the request property `data/anyOf[subschema #1: dataset_id]/_internal_btql` became not nullable - the request property `data/anyOf[subschema #1: dataset_id]/_internal_btql/additionalProperties/` became not nullable - the request property `data/anyOf[subschema #1: dataset_id]/dataset_environment` became not nullable - the request property `data/anyOf[subschema #1: dataset_id]/dataset_version` became not nullable - the request property `data/anyOf[subschema #2: project_dataset_name]/_internal_btql` became not nullable - the request property `data/anyOf[subschema #2: project_dataset_name]/_internal_btql/additionalProperties/` became not nullable - the request property `data/anyOf[subschema #2: project_dataset_name]/dataset_environment` became not nullable - the request property `data/anyOf[subschema #2: project_dataset_name]/dataset_version` became not nullable - the request property `data/anyOf[subschema #3: dataset_rows]/data/items/` became not nullable - the request property `endpoint_name` became not nullable - the request property `git_metadata_settings` became not nullable - the request property `is_public` became not nullable - the request property `max_concurrency` became not nullable - the request property `metadata/additionalProperties/` became not nullable - the request property `parameters/additionalProperties/` became not nullable - the request property `parent/allOf[#/components/schemas/InvokeParent]/anyOf[subschema #1: span_parent_struct]/propagated_event` became not nullable - the request property `parent/allOf[#/components/schemas/InvokeParent]/anyOf[subschema #1: span_parent_struct]/propagated_event/additionalProperties/` became not nullable - the request property `parent/allOf[#/components/schemas/InvokeParent]/anyOf[subschema #1: span_parent_struct]/row_ids` became not nullable - the request property `repo_info/allOf[#/components/schemas/RepoInfo]/` became not nullable - the request property `repo_info/allOf[#/components/schemas/RepoInfo]/author_email` became not nullable - the request property `repo_info/allOf[#/components/schemas/RepoInfo]/author_name` became not nullable - the request property `repo_info/allOf[#/components/schemas/RepoInfo]/branch` became not nullable - the request property `repo_info/allOf[#/components/schemas/RepoInfo]/commit` became not nullable - the request property `repo_info/allOf[#/components/schemas/RepoInfo]/commit_message` became not nullable - the request property `repo_info/allOf[#/components/schemas/RepoInfo]/commit_time` became not nullable - the request property `repo_info/allOf[#/components/schemas/RepoInfo]/dirty` became not nullable - the request property `repo_info/allOf[#/components/schemas/RepoInfo]/git_diff` became not nullable - the request property `repo_info/allOf[#/components/schemas/RepoInfo]/tag` became not nullable - the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #5: inline_code]/name` became not nullable - the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_function/additionalProperties/` became not nullable - the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/mcp` became not nullable - the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/mcp/additionalProperties/oneOf[subschema #1: MCP server id. This is used for project-level MCP server definitions.]/enabled_tools` became not nullable - the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/mcp/additionalProperties/oneOf[subschema #2: MCP server url. This is used for inline definitions of MCP servers.]/enabled_tools` became not nullable - the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/options` became not nullable - the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/options/endpoint_name` became not nullable - the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/options/params/anyOf[subschema #1: OpenAIModelParams]/additionalProperties/` became not nullable - the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/options/params/anyOf[subschema #1: OpenAIModelParams]/chat_template_kwargs/additionalProperties/` became not nullable - the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/options/params/anyOf[subschema #1: OpenAIModelParams]/response_format/anyOf[subschema #2: json_schema]/json_schema/schema/anyOf[subschema #1: object]/additionalProperties/` became not nullable - …122 more - **2026-10-29** `6409b3f2bde5`: 1 info - added the new optional request property `data/anyOf[subschema #3: dataset_rows]/source_dataset_id` - **2026-10-03** `877ab1fd2a22`: 4 info - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/options/params/anyOf[subschema #1: OpenAIModelParams]/chat_template_kwargs` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/options/params/anyOf[subschema #1: OpenAIModelParams]/chat_template_kwargs` - added the new optional request property `task/anyOf[subschema #6: inline_function]/inline_prompt/options/params/anyOf[subschema #1: OpenAIModelParams]/chat_template_kwargs` - added the new optional request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/options/params/anyOf[subschema #1: OpenAIModelParams]/chat_template_kwargs` - **2026-09-22** `2e0e9e00d0bd`: 4 info - added `#/components/schemas/ChatCompletionContentPartInputAudioWithTitle` to the `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #2: user]/content/anyOf[subschema #2: array]/items/` request property `anyOf` list - added `#/components/schemas/ChatCompletionContentPartInputAudioWithTitle` to the `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #2: user]/content/anyOf[subschema #2: array]/items/` request property `anyOf` list - added `#/components/schemas/ChatCompletionContentPartInputAudioWithTitle` to the `task/anyOf[subschema #6: inline_function]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #2: user]/content/anyOf[subschema #2: array]/items/` request property `anyOf` list - added `#/components/schemas/ChatCompletionContentPartInputAudioWithTitle` to the `task/anyOf[subschema #7: inline_prompt]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #2: user]/content/anyOf[subschema #2: array]/items/` request property `anyOf` list - **2026-08-21** `2ddd4c0bfd2c`: 5 info - added `subschema #3: preprocessor_inline` to the `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/preprocessor` request property `anyOf` list - added `subschema #3: preprocessor_inline` to the `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/preprocessor` request property `anyOf` list - added `subschema #3: preprocessor_inline` to the `task/anyOf[subschema #6: inline_function]/inline_prompt/preprocessor` request property `anyOf` list - added `subschema #3: preprocessor_inline` to the `task/anyOf[subschema #7: inline_prompt]/inline_prompt/preprocessor` request property `anyOf` list - added `subschema #4: experiment_name` to the `data` request property `anyOf` list - **2026-08-13** `e05ef145579d`: 41 info - added the new optional request property `endpoint_name` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/options/endpoint_name` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/parser/allow_skip` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/preprocessor` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #1: system]/content/anyOf[subschema #2: array]/items/cache_control/ttl` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #2: user]/content/anyOf[subschema #2: array]/items/anyOf[subschema #1: text]/cache_control/ttl` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #2: user]/content/anyOf[subschema #2: array]/items/anyOf[subschema #2: image_url]/cache_control` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #2: user]/content/anyOf[subschema #2: array]/items/anyOf[subschema #3: file]/cache_control` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #3: assistant]/content/anyOf[subschema #2]/items/cache_control/ttl` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #4: tool]/content/anyOf[subschema #2: array]/items/cache_control/ttl` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #6: developer]/content/anyOf[subschema #2: array]/items/cache_control/ttl` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/options/endpoint_name` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/parser/allow_skip` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/preprocessor` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #1: system]/content/anyOf[subschema #2: array]/items/cache_control/ttl` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #2: user]/content/anyOf[subschema #2: array]/items/anyOf[subschema #1: text]/cache_control/ttl` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #2: user]/content/anyOf[subschema #2: array]/items/anyOf[subschema #2: image_url]/cache_control` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #2: user]/content/anyOf[subschema #2: array]/items/anyOf[subschema #3: file]/cache_control` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #3: assistant]/content/anyOf[subschema #2]/items/cache_control/ttl` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #4: tool]/content/anyOf[subschema #2: array]/items/cache_control/ttl` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #6: developer]/content/anyOf[subschema #2: array]/items/cache_control/ttl` - added the new optional request property `task/anyOf[subschema #6: inline_function]/inline_prompt/options/endpoint_name` - added the new optional request property `task/anyOf[subschema #6: inline_function]/inline_prompt/parser/allow_skip` - added the new optional request property `task/anyOf[subschema #6: inline_function]/inline_prompt/preprocessor` - added the new optional request property `task/anyOf[subschema #6: inline_function]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #1: system]/content/anyOf[subschema #2: array]/items/cache_control/ttl` - added the new optional request property `task/anyOf[subschema #6: inline_function]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #2: user]/content/anyOf[subschema #2: array]/items/anyOf[subschema #1: text]/cache_control/ttl` - added the new optional request property `task/anyOf[subschema #6: inline_function]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #2: user]/content/anyOf[subschema #2: array]/items/anyOf[subschema #2: image_url]/cache_control` - added the new optional request property `task/anyOf[subschema #6: inline_function]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #2: user]/content/anyOf[subschema #2: array]/items/anyOf[subschema #3: file]/cache_control` - added the new optional request property `task/anyOf[subschema #6: inline_function]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #3: assistant]/content/anyOf[subschema #2]/items/cache_control/ttl` - added the new optional request property `task/anyOf[subschema #6: inline_function]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #4: tool]/content/anyOf[subschema #2: array]/items/cache_control/ttl` - added the new optional request property `task/anyOf[subschema #6: inline_function]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #6: developer]/content/anyOf[subschema #2: array]/items/cache_control/ttl` - added the new optional request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/options/endpoint_name` - added the new optional request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/parser/allow_skip` - added the new optional request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/preprocessor` - added the new optional request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #1: system]/content/anyOf[subschema #2: array]/items/cache_control/ttl` - added the new optional request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #2: user]/content/anyOf[subschema #2: array]/items/anyOf[subschema #1: text]/cache_control/ttl` - added the new optional request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #2: user]/content/anyOf[subschema #2: array]/items/anyOf[subschema #2: image_url]/cache_control` - added the new optional request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #2: user]/content/anyOf[subschema #2: array]/items/anyOf[subschema #3: file]/cache_control` - added the new optional request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #3: assistant]/content/anyOf[subschema #2]/items/cache_control/ttl` - added the new optional request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #4: tool]/content/anyOf[subschema #2: array]/items/cache_control/ttl` - …1 more - **2026-05-21** `7c3461755f69`: 4 info - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #3: assistant]/reasoning_signature` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #3: assistant]/reasoning_signature` - added the new optional request property `task/anyOf[subschema #6: inline_function]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #3: assistant]/reasoning_signature` - added the new optional request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #3: assistant]/reasoning_signature` - **2026-04-25** `d51a7016439c`: 4 info - added the new optional request property `data/anyOf[subschema #1: dataset_id]/dataset_environment` - added the new optional request property `data/anyOf[subschema #1: dataset_id]/dataset_version` - added the new optional request property `data/anyOf[subschema #2: project_dataset_name]/dataset_environment` - added the new optional request property `data/anyOf[subschema #2: project_dataset_name]/dataset_version` - **2026-04-08** `a21b724fece9`: 2 info - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #5: inline_code]/function_type` - added the new optional request property `task/anyOf[subschema #5: inline_code]/function_type` - **2026-03-04** `79e3efbd784c`: 16 info - added the new optional request property `name` - added the new optional request property `parameters` - added the new `sandbox` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #3: global_function]/function_type` - added the new `sandbox` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/function_type` - added the new `sandbox` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/tool_functions/items/allOf[#/components/schemas/SavedFunctionId]/anyOf[subschema #2: global]/function_type` - added the new `sandbox` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/tool_functions/items/allOf[subschema #2]/anyOf[subschema #2: global]/function_type` - added the new `sandbox` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/function_type` - added the new `sandbox` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/tool_functions/items/allOf[#/components/schemas/SavedFunctionId]/anyOf[subschema #2: global]/function_type` - added the new `sandbox` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/tool_functions/items/allOf[subschema #2]/anyOf[subschema #2: global]/function_type` - added the new `sandbox` enum value to the request property `task/anyOf[subschema #3: global_function]/function_type` - added the new `sandbox` enum value to the request property `task/anyOf[subschema #6: inline_function]/function_type` - added the new `sandbox` enum value to the request property `task/anyOf[subschema #6: inline_function]/inline_prompt/tool_functions/items/allOf[#/components/schemas/SavedFunctionId]/anyOf[subschema #2: global]/function_type` - added the new `sandbox` enum value to the request property `task/anyOf[subschema #6: inline_function]/inline_prompt/tool_functions/items/allOf[subschema #2]/anyOf[subschema #2: global]/function_type` - added the new `sandbox` enum value to the request property `task/anyOf[subschema #7: inline_prompt]/function_type` - added the new `sandbox` enum value to the request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/tool_functions/items/allOf[#/components/schemas/SavedFunctionId]/anyOf[subschema #2: global]/function_type` - added the new `sandbox` enum value to the request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/tool_functions/items/allOf[subschema #2]/anyOf[subschema #2: global]/function_type` - **2026-02-10** `4918f9bd942e`: 14 info - added the new `parameters` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #3: global_function]/function_type` - added the new `parameters` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/function_type` - added the new `parameters` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/tool_functions/items/allOf[#/components/schemas/SavedFunctionId]/anyOf[subschema #2: global]/function_type` - added the new `parameters` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/tool_functions/items/allOf[subschema #2]/anyOf[subschema #2: global]/function_type` - added the new `parameters` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/function_type` - added the new `parameters` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/tool_functions/items/allOf[#/components/schemas/SavedFunctionId]/anyOf[subschema #2: global]/function_type` - added the new `parameters` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/tool_functions/items/allOf[subschema #2]/anyOf[subschema #2: global]/function_type` - added the new `parameters` enum value to the request property `task/anyOf[subschema #3: global_function]/function_type` - added the new `parameters` enum value to the request property `task/anyOf[subschema #6: inline_function]/function_type` - added the new `parameters` enum value to the request property `task/anyOf[subschema #6: inline_function]/inline_prompt/tool_functions/items/allOf[#/components/schemas/SavedFunctionId]/anyOf[subschema #2: global]/function_type` - added the new `parameters` enum value to the request property `task/anyOf[subschema #6: inline_function]/inline_prompt/tool_functions/items/allOf[subschema #2]/anyOf[subschema #2: global]/function_type` - added the new `parameters` enum value to the request property `task/anyOf[subschema #7: inline_prompt]/function_type` - added the new `parameters` enum value to the request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/tool_functions/items/allOf[#/components/schemas/SavedFunctionId]/anyOf[subschema #2: global]/function_type` - added the new `parameters` enum value to the request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/tool_functions/items/allOf[subschema #2]/anyOf[subschema #2: global]/function_type` - **2026-02-02** `8dda984bb502`: 8 breaking - added `#/components/schemas/SavedFunctionId, subschema #2` to the `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/tool_functions/items/` request property `allOf` list - added `#/components/schemas/SavedFunctionId, subschema #2` to the `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/tool_functions/items/` request property `allOf` list - added `#/components/schemas/SavedFunctionId, subschema #2` to the `task/anyOf[subschema #6: inline_function]/inline_prompt/tool_functions/items/` request property `allOf` list - added `#/components/schemas/SavedFunctionId, subschema #2` to the `task/anyOf[subschema #7: inline_prompt]/inline_prompt/tool_functions/items/` request property `allOf` list - removed `subschema #1: function, subschema #2: global` from the `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/tool_functions/items/` request property `anyOf` list - removed `subschema #1: function, subschema #2: global` from the `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/tool_functions/items/` request property `anyOf` list - removed `subschema #1: function, subschema #2: global` from the `task/anyOf[subschema #6: inline_function]/inline_prompt/tool_functions/items/` request property `anyOf` list - removed `subschema #1: function, subschema #2: global` from the `task/anyOf[subschema #7: inline_prompt]/inline_prompt/tool_functions/items/` request property `anyOf` list - **2026-01-23** `79b5f945907c`: 32 info - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/parser/allow_no_match` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/parser/choice` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/parser/allow_no_match` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/parser/choice` - added the new optional request property `task/anyOf[subschema #6: inline_function]/inline_prompt/parser/allow_no_match` - added the new optional request property `task/anyOf[subschema #6: inline_function]/inline_prompt/parser/choice` - added the new optional request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/parser/allow_no_match` - added the new optional request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/parser/choice` - the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/parser/choice_scores` became optional - the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/parser/choice_scores` became optional - the request property `task/anyOf[subschema #6: inline_function]/inline_prompt/parser/choice_scores` became optional - the request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/parser/choice_scores` became optional - added the new `classifier` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #3: global_function]/function_type` - added the new `classifier` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/function_type` - added the new `classifier` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/tool_functions/items/anyOf[subschema #2: global]/function_type` - added the new `classifier` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/function_type` - added the new `classifier` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/tool_functions/items/anyOf[subschema #2: global]/function_type` - added the new `classifier` enum value to the request property `task/anyOf[subschema #3: global_function]/function_type` - added the new `classifier` enum value to the request property `task/anyOf[subschema #6: inline_function]/function_type` - added the new `classifier` enum value to the request property `task/anyOf[subschema #6: inline_function]/inline_prompt/tool_functions/items/anyOf[subschema #2: global]/function_type` - added the new `classifier` enum value to the request property `task/anyOf[subschema #7: inline_prompt]/function_type` - added the new `classifier` enum value to the request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/tool_functions/items/anyOf[subschema #2: global]/function_type` - added the new `tag` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #3: global_function]/function_type` - added the new `tag` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/function_type` - added the new `tag` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/tool_functions/items/anyOf[subschema #2: global]/function_type` - added the new `tag` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/function_type` - added the new `tag` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/tool_functions/items/anyOf[subschema #2: global]/function_type` - added the new `tag` enum value to the request property `task/anyOf[subschema #3: global_function]/function_type` - added the new `tag` enum value to the request property `task/anyOf[subschema #6: inline_function]/function_type` - added the new `tag` enum value to the request property `task/anyOf[subschema #6: inline_function]/inline_prompt/tool_functions/items/anyOf[subschema #2: global]/function_type` - added the new `tag` enum value to the request property `task/anyOf[subschema #7: inline_prompt]/function_type` - added the new `tag` enum value to the request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/tool_functions/items/anyOf[subschema #2: global]/function_type` - **2026-01-13** `97c5791b3df1`: 6 breaking, 10 info - the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #3: global_function]/function_type` became not nullable - the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/tool_functions/items/anyOf[subschema #2: global]/function_type` became not nullable - the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/tool_functions/items/anyOf[subschema #2: global]/function_type` became not nullable - the request property `task/anyOf[subschema #3: global_function]/function_type` became not nullable - the request property `task/anyOf[subschema #6: inline_function]/inline_prompt/tool_functions/items/anyOf[subschema #2: global]/function_type` became not nullable - the request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/tool_functions/items/anyOf[subschema #2: global]/function_type` became not nullable - the `function_type` request property default value `scorer` was added - the `function_type` request property default value `scorer` was added - the `function_type` request property default value `scorer` was added - the `function_type` request property default value `scorer` was added - the `function_type` request property default value `scorer` was added - the `function_type` request property default value `scorer` was added - the `function_type` request property default value `scorer` was added - the `function_type` request property default value `scorer` was added - the `function_type` request property default value `scorer` was added - the `function_type` request property default value `scorer` was added - **2026-01-08** `c7496daaaa37`: 20 info - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #3: global_function]/function_type` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/template_format` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/tool_functions/items/anyOf[subschema #2: global]/function_type` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/template_format` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/tool_functions/items/anyOf[subschema #2: global]/function_type` - added the new optional request property `task/anyOf[subschema #3: global_function]/function_type` - added the new optional request property `task/anyOf[subschema #6: inline_function]/inline_prompt/template_format` - added the new optional request property `task/anyOf[subschema #6: inline_function]/inline_prompt/tool_functions/items/anyOf[subschema #2: global]/function_type` - added the new optional request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/template_format` - added the new optional request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/tool_functions/items/anyOf[subschema #2: global]/function_type` - added the new `facet` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/function_type` - added the new `facet` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/function_type` - added the new `facet` enum value to the request property `task/anyOf[subschema #6: inline_function]/function_type` - added the new `facet` enum value to the request property `task/anyOf[subschema #7: inline_prompt]/function_type` - added the new `preprocessor` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/function_type` - added the new `preprocessor` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/function_type` - added the new `preprocessor` enum value to the request property `task/anyOf[subschema #6: inline_function]/function_type` - added the new `preprocessor` enum value to the request property `task/anyOf[subschema #7: inline_prompt]/function_type` - added the new `quickjs` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #5: inline_code]/inline_context/runtime` - added the new `quickjs` enum value to the request property `task/anyOf[subschema #5: inline_code]/inline_context/runtime` - **2025-12-04** `b6967d956e2f`: 19 info - added the new optional request property `mcp_auth` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/mcp` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/mcp` - added the new optional request property `task/anyOf[subschema #6: inline_function]/inline_prompt/mcp` - added the new optional request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/mcp` - added `#/components/schemas/ChatCompletionContentPartFileWithTitle` to the `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #2: user]/content/anyOf[subschema #2: array]/items/` request property `anyOf` list - added `#/components/schemas/ChatCompletionContentPartFileWithTitle` to the `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #2: user]/content/anyOf[subschema #2: array]/items/` request property `anyOf` list - added `#/components/schemas/ChatCompletionContentPartFileWithTitle` to the `task/anyOf[subschema #6: inline_function]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #2: user]/content/anyOf[subschema #2: array]/items/` request property `anyOf` list - added `#/components/schemas/ChatCompletionContentPartFileWithTitle` to the `task/anyOf[subschema #7: inline_prompt]/inline_prompt/prompt/anyOf[subschema #1: chat]/messages/items/anyOf[subschema #2: user]/content/anyOf[subschema #2: array]/items/` request property `anyOf` list - added the new `browser` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #5: inline_code]/inline_context/runtime` - added the new `browser` enum value to the request property `task/anyOf[subschema #5: inline_code]/inline_context/runtime` - added the new `custom_view` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/function_type` - added the new `custom_view` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/function_type` - added the new `custom_view` enum value to the request property `task/anyOf[subschema #6: inline_function]/function_type` - added the new `custom_view` enum value to the request property `task/anyOf[subschema #7: inline_prompt]/function_type` - added the new `none` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/options/params/anyOf[subschema #1: OpenAIModelParams]/reasoning_effort` - added the new `none` enum value to the request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/options/params/anyOf[subschema #1: OpenAIModelParams]/reasoning_effort` - added the new `none` enum value to the request property `task/anyOf[subschema #6: inline_function]/inline_prompt/options/params/anyOf[subschema #1: OpenAIModelParams]/reasoning_effort` - added the new `none` enum value to the request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/options/params/anyOf[subschema #1: OpenAIModelParams]/reasoning_effort` - **2025-11-18** `ae80b8fa951b`: 32 info - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/options/params/anyOf[subschema #1: OpenAIModelParams]/reasoning_budget` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/options/params/anyOf[subschema #1: OpenAIModelParams]/reasoning_enabled` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/options/params/anyOf[subschema #3: GoogleModelParams]/reasoning_budget` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/options/params/anyOf[subschema #3: GoogleModelParams]/reasoning_enabled` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/options/params/anyOf[subschema #4: WindowAIModelParams]/reasoning_budget` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/options/params/anyOf[subschema #4: WindowAIModelParams]/reasoning_enabled` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/options/params/anyOf[subschema #5: JsCompletionParams]/reasoning_budget` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #6: inline_function]/inline_prompt/options/params/anyOf[subschema #5: JsCompletionParams]/reasoning_enabled` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/options/params/anyOf[subschema #1: OpenAIModelParams]/reasoning_budget` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/options/params/anyOf[subschema #1: OpenAIModelParams]/reasoning_enabled` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/options/params/anyOf[subschema #3: GoogleModelParams]/reasoning_budget` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/options/params/anyOf[subschema #3: GoogleModelParams]/reasoning_enabled` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/options/params/anyOf[subschema #4: WindowAIModelParams]/reasoning_budget` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/options/params/anyOf[subschema #4: WindowAIModelParams]/reasoning_enabled` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/options/params/anyOf[subschema #5: JsCompletionParams]/reasoning_budget` - added the new optional request property `scores/items/allOf[#/components/schemas/FunctionId]/anyOf[subschema #7: inline_prompt]/inline_prompt/options/params/anyOf[subschema #5: JsCompletionParams]/reasoning_enabled` - added the new optional request property `task/anyOf[subschema #6: inline_function]/inline_prompt/options/params/anyOf[subschema #1: OpenAIModelParams]/reasoning_budget` - added the new optional request property `task/anyOf[subschema #6: inline_function]/inline_prompt/options/params/anyOf[subschema #1: OpenAIModelParams]/reasoning_enabled` - added the new optional request property `task/anyOf[subschema #6: inline_function]/inline_prompt/options/params/anyOf[subschema #3: GoogleModelParams]/reasoning_budget` - added the new optional request property `task/anyOf[subschema #6: inline_function]/inline_prompt/options/params/anyOf[subschema #3: GoogleModelParams]/reasoning_enabled` - added the new optional request property `task/anyOf[subschema #6: inline_function]/inline_prompt/options/params/anyOf[subschema #4: WindowAIModelParams]/reasoning_budget` - added the new optional request property `task/anyOf[subschema #6: inline_function]/inline_prompt/options/params/anyOf[subschema #4: WindowAIModelParams]/reasoning_enabled` - added the new optional request property `task/anyOf[subschema #6: inline_function]/inline_prompt/options/params/anyOf[subschema #5: JsCompletionParams]/reasoning_budget` - added the new optional request property `task/anyOf[subschema #6: inline_function]/inline_prompt/options/params/anyOf[subschema #5: JsCompletionParams]/reasoning_enabled` - added the new optional request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/options/params/anyOf[subschema #1: OpenAIModelParams]/reasoning_budget` - added the new optional request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/options/params/anyOf[subschema #1: OpenAIModelParams]/reasoning_enabled` - added the new optional request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/options/params/anyOf[subschema #3: GoogleModelParams]/reasoning_budget` - added the new optional request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/options/params/anyOf[subschema #3: GoogleModelParams]/reasoning_enabled` - added the new optional request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/options/params/anyOf[subschema #4: WindowAIModelParams]/reasoning_budget` - added the new optional request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/options/params/anyOf[subschema #4: WindowAIModelParams]/reasoning_enabled` - added the new optional request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/options/params/anyOf[subschema #5: JsCompletionParams]/reasoning_budget` - added the new optional request property `task/anyOf[subschema #7: inline_prompt]/inline_prompt/options/params/anyOf[subschema #5: JsCompletionParams]/reasoning_enabled` - …earlier changes are on the page: https://skmtc.dev/braintrustdata/apis/braintrust-api/changes/v1/eval/post --- [Operation](https://skmtc.dev/braintrustdata/apis/braintrust-api/docs/v1/eval/post.md) - [API](https://skmtc.dev/braintrustdata/apis/braintrust-api.md) - [Page](https://skmtc.dev/braintrustdata/apis/braintrust-api/changes/v1/eval/post)