Evals

Changes to Create eval run

post/evals/{eval_id}/runs

Oct 26, 20266f5c52c2ff04 Revision changes
- info
  added the new optional request property ////////////
- info
  added the new optional request property ////////////
- info
  added the new optional request property ////////////
- info
  added the new optional request property ///////////
- info
  added the new optional request property ////////////
- info
  added the new optional request property ///////////
- info
  added the new optional request property ////////////
- info
  added the optional property //////////// to the response with the status
- info
  added the optional property //////////// to the response with the status
- info
  added the optional property //////////// to the response with the status
- info
  added the optional property /////////// to the response with the status
- info
  added the optional property //////////// to the response with the status
- info
  added the optional property /////////// to the response with the status
- info
  added the optional property //////////// to the response with the status
Oct 23, 2026f1af3e12b410 Revision changes
- info
  the request property default value changed from gpt-image-1 to gpt-image-2
- info
  the response's property default value changed from gpt-image-1 to gpt-image-2 for the status
Oct 6, 2026e2f8d8cbc41f Revision changes
- info
  added the optional property // to the response with the status
- info
  added the optional property // to the response with the status
- info
  added the optional property // to the response with the status
- info
  added the optional property // to the response with the status
Sep 29, 20265bc613d74aef Revision changes
- breaking
  the response property became nullable for the status
- breaking
  the response property became nullable for the status
- breaking
  the response property became nullable for the status
- breaking
  the response property became nullable for the status
- breaking
  the response's property type changed from object to no type for status
- breaking
  removed the required property / from the response with the status
- breaking
  removed the required property / from the response with the status
- info
  added subschema #2 to the response property anyOf list for the response status
Sep 28, 202617f4bc11b90f Revision changes
- breaking
  removed subschema #2 from the ///////////// request property oneOf list
- breaking
  added to the ///////////// response property oneOf list for the response status
- info
  added to the ///////////// request property oneOf list
- info
  removed subschema #2 from the ///////////// response property oneOf list for the response status
Sep 25, 2026d86203de41ae Revision changes
- breaking
  removed the required property from the response with the status
- breaking
  removed the required property from the response with the status
- breaking
  removed the required property from the response with the status
- breaking
  removed the required property from the response with the status
- warning
  removed the optional property from the response with the status
- info
  added the non-success response with the status
- info
  added the non-success response with the status
- info
  added the required property to the response with the status
Sep 16, 20262cd8933757a4 Revision changes
- info
  request property ////// deprecated
- info
  response property data_source/oneOf[subschema #3: ResponsesRunDataSource]/sampling_params/tools/items/oneOf[subschema #6: MCP tool]/connector_id deprecated
Sep 8, 2026bb9b3b410112 Revision changes
- warning
  added the new gpt-image-2 enum value to the /////// response property for the response status
- warning
  added the new gpt-image-2-2026-04-21 enum value to the /////// response property for the response status
- warning
  added the new gpt-image-2.5-flare enum value to the /////// response property for the response status
- warning
  added the new gpt-image-2.5-flare-2026-09-08 enum value to the /////// response property for the response status
- warning
  added the new gpt-image-2.5-sunburst enum value to the /////// response property for the response status
- warning
  added the new gpt-image-2.5-sunburst-2026-09-08 enum value to the /////// response property for the response status
- warning
  added the new max enum value to the ////// response property for the response status
- warning
  added the new xhigh enum value to the ////// response property for the response status
- info
  added the new optional request property //////
- info
  added the new optional request property ////////////
- info
  added the new optional request property /////////
- info
  added the new optional request property //////
- info
  added the new optional request property //////
- info
  added the new gpt-image-2 enum value to the request property ///////
- info
  added the new gpt-image-2-2026-04-21 enum value to the request property ///////
- info
  added the new gpt-image-2.5-flare enum value to the request property ///////
- info
  added the new gpt-image-2.5-flare-2026-09-08 enum value to the request property ///////
- info
  added the new gpt-image-2.5-sunburst enum value to the request property ///////
- info
  added the new gpt-image-2.5-sunburst-2026-09-08 enum value to the request property ///////
- info
  added the new max enum value to the request property //////
- info
  added the new xhigh enum value to the request property //////
- info
  added the non-success response with the status
- info
  added the optional property ////// to the response with the status
- info
  added the optional property //////////// to the response with the status
- info
  added the optional property ///////// to the response with the status
- info
  added the optional property ////// to the response with the status
- info
  added the optional property ////// to the response with the status
- info
  added the optional property to the response with the status
Sep 8, 2026185927e212ab Revision changes
- warning
  added the new gpt-image-2.5-flare enum value to the /////// response property for the response status
- warning
  added the new gpt-image-2.5-flare-2026-09-08 enum value to the /////// response property for the response status
- warning
  added the new gpt-image-2.5-sunburst enum value to the /////// response property for the response status
- warning
  added the new gpt-image-2.5-sunburst-2026-09-08 enum value to the /////// response property for the response status
- warning
  added the new max enum value to the ////// response property for the response status
- warning
  added the new xhigh enum value to the ////// response property for the response status
- info
  added the new gpt-image-2.5-flare enum value to the request property ///////
- info
  added the new gpt-image-2.5-flare-2026-09-08 enum value to the request property ///////
- info
  added the new gpt-image-2.5-sunburst enum value to the request property ///////
- info
  added the new gpt-image-2.5-sunburst-2026-09-08 enum value to the request property ///////
- info
  added the new max enum value to the request property //////
- info
  added the new xhigh enum value to the request property //////
Sep 3, 20269430b00d75b4 Revision changes
- info
  added the new optional request property //////
- info
  added the new optional request property ////////////
- info
  added the new optional request property /////////
- info
  added the new optional request property //////
- info
  added the optional property ////// to the response with the status
- info
  added the optional property //////////// to the response with the status
- info
  added the optional property ///////// to the response with the status
- info
  added the optional property ////// to the response with the status
- info
  added the optional property / to the response with the status
- info
  added the optional property to the response with the status
Aug 20, 20265de4ab93fa24 Revision changes
- warning
  added the new gpt-image-2 enum value to the /////// response property for the response status
- warning
  added the new gpt-image-2-2026-04-21 enum value to the /////// response property for the response status
- info
  added the new gpt-image-2 enum value to the request property ///////
- info
  added the new gpt-image-2-2026-04-21 enum value to the request property ///////
Aug 14, 20266ac2618eefd7 Revision changes
- info
  added the non-success response with the status
Aug 13, 2026fc45a2f64c0a Revision changes
- info
  added the new optional request property //////
- info
  added the optional property ////// to the response with the status
Aug 5, 2026ab0c5306e390 Revision changes
- breaking
  the ////// response property's minLength was decreased from 1 to 0 for the response status
- breaking
  added to the //// response property oneOf list for the response status
- warning
  added the new auto enum value to the /////////// response property for the response status
- warning
  added the new max enum value to the //// response property for the response status
- warning
  added the new max enum value to the //// response property for the response status
- warning
  added the new max enum value to the ///////// response property for the response status
- info
  added the new optional request property ///////////
- info
  added the new optional request property ///////////
- info
  added the new optional request property ///////////
- info
  added the new optional request property //////////
- info
  added the new optional request property ///////////
- info
  added the new optional request property //////////
- info
  added the new optional request property ///////////
- info
  added the new optional request property //////
- info
  added the new optional request property //////
- info
  added the new optional request property ////////////
- info
  added the new optional request property ////////////
- info
  added the new optional request property /////////
- info
  added the new optional request property //////
- info
  added the new optional request property //////
- info
  added the new optional request property //////
- info
  added the new optional request property //////
- info
  added the new optional request property //////
- info
  added the new optional request property //////
- info
  added the new auto enum value to the request property ///////////
- info
  added the new max enum value to the request property ////
- info
  added the new max enum value to the request property ////
- info
  added the new max enum value to the request property /////////
- info
  the ////// request property's minLength was decreased from 1 to 0
- info
  added to the //// request property oneOf list
- info
  added the optional property /////////// to the response with the status
- info
  added the optional property /////////// to the response with the status
- info
  added the optional property /////////// to the response with the status
- info
  added the optional property ////////// to the response with the status
- info
  added the optional property /////////// to the response with the status
- info
  added the optional property ////////// to the response with the status
- info
  added the optional property /////////// to the response with the status
- info
  added the optional property ////// to the response with the status
- info
  added the optional property ////// to the response with the status
- info
  added the optional property //////////// to the response with the status
- info
  added the optional property //////////// to the response with the status
- info
  added the optional property ///////// to the response with the status
- info
  added the optional property ////// to the response with the status
- info
  added the optional property ////// to the response with the status
- info
  added the optional property ////// to the response with the status
- info
  added the optional property ////// to the response with the status
- info
  added the optional property ////// to the response with the status
- info
  added the optional property ////// to the response with the status
Aug 4, 20264d5ff0000988 Revision changes
- breaking
  the ////// response property's minLength was decreased from 1 to 0 for the response status
- info
  the ////// request property's minLength was decreased from 1 to 0
Jul 15, 20264065aec90c5d Revision changes
- breaking
  added to the //// response property oneOf list for the response status
- warning
  added the new auto enum value to the /////////// response property for the response status
- warning
  added the new max enum value to the //// response property for the response status
- warning
  added the new max enum value to the //// response property for the response status
- warning
  added the new max enum value to the ///////// response property for the response status
- info
  added the new optional request property ///////////
- info
  added the new optional request property ///////////
- info
  added the new optional request property ///////////
- info
  added the new optional request property //////////
- info
  added the new optional request property ///////////
- info
  added the new optional request property //////////
- info
  added the new optional request property ///////////
- info
  added the new optional request property //////
- info
  added the new optional request property //////
- info
  added the new optional request property ////////////
- info
  added the new optional request property ////////////
- info
  added the new optional request property /////////
- info
  added the new optional request property //////
- info
  added the new optional request property //////
- info
  added the new optional request property //////
- info
  added the new optional request property //////
- info
  added the new optional request property //////
- info
  added the new optional request property //////
- info
  added the new auto enum value to the request property ///////////
- info
  added the new max enum value to the request property ////
- info
  added the new max enum value to the request property ////
- info
  added the new max enum value to the request property /////////
- info
  added to the //// request property oneOf list
- info
  added the optional property /////////// to the response with the status
- info
  added the optional property /////////// to the response with the status
- info
  added the optional property /////////// to the response with the status
- info
  added the optional property ////////// to the response with the status
- info
  added the optional property /////////// to the response with the status
- info
  added the optional property ////////// to the response with the status
- info
  added the optional property /////////// to the response with the status
- info
  added the optional property ////// to the response with the status
- info
  added the optional property ////// to the response with the status
- info
  added the optional property //////////// to the response with the status
- info
  added the optional property //////////// to the response with the status
- info
  added the optional property ///////// to the response with the status
- info
  added the optional property ////// to the response with the status
- info
  added the optional property ////// to the response with the status
- info
  added the optional property ////// to the response with the status
- info
  added the optional property ////// to the response with the status
- info
  added the optional property ////// to the response with the status
- info
  added the optional property ////// to the response with the status
Jul 9, 2026e0508a503b84 Revision changes
- warning
  added the new auto enum value to the /////////// response property for the response status
- warning
  added the new max enum value to the //// response property for the response status
- warning
  added the new max enum value to the //// response property for the response status
- warning
  added the new max enum value to the ///////// response property for the response status
- info
  added the new optional request property ///////////
- info
  added the new optional request property ///////////
- info
  added the new optional request property ///////////
- info
  added the new optional request property //////////
- info
  added the new optional request property ///////////
- info
  added the new optional request property //////////
- info
  added the new optional request property ///////////
- info
  added the new optional request property //////
- info
  added the new optional request property //////
- info
  added the new optional request property ////////////
- info
  added the new optional request property ////////////
- info
  added the new optional request property /////////
- info
  added the new optional request property //////
- info
  added the new optional request property //////
- info
  added the new optional request property //////
- info
  added the new optional request property //////
- info
  added the new optional request property //////
- info
  added to the //// request property anyOf list
- info
  added the new auto enum value to the request property ///////////
- info
  added the new max enum value to the request property ////
- info
  added the new max enum value to the request property ////
- info
  added the new max enum value to the request property /////////
- info
  added the optional property /////////// to the response with the status
- info
  added the optional property /////////// to the response with the status
- info
  added the optional property /////////// to the response with the status
- info
  added the optional property ////////// to the response with the status
- info
  added the optional property /////////// to the response with the status
- info
  added the optional property ////////// to the response with the status
- info
  added the optional property /////////// to the response with the status
- info
  added the optional property ////// to the response with the status
- info
  added the optional property ////// to the response with the status
- info
  added the optional property //////////// to the response with the status
- info
  added the optional property //////////// to the response with the status
- info
  added the optional property ///////// to the response with the status
- info
  added the optional property ////// to the response with the status
- info
  added the optional property ////// to the response with the status
- info
  added the optional property ////// to the response with the status
- info
  added the optional property ////// to the response with the status
- info
  added the optional property ////// to the response with the status
- info
  added to the //// response property anyOf list for the response status
Jun 17, 2026827fa3e74ce9 Revision changes
- info
  added the new optional request property //////
- info
  added the optional property ////// to the response with the status
May 13, 202674cbcf73838f Revision changes
- breaking
  the request property //// became not nullable
- breaking
  the request property //// became not nullable
- breaking
  the request property //// became not nullable
- breaking
  the request property //// became not nullable
- breaking
  the request property //// became not nullable
- breaking
  the request property //// became not nullable
- breaking
  the request property //// became not nullable
- breaking
  the request property //// became not nullable
- breaking
  the request property //// became not nullable
- breaking
  the request property //// became not nullable
- breaking
  the request property //// became not nullable
- breaking
  the request property //// became not nullable
- breaking
  the request property //// became not nullable
- breaking
  the request property //// became not nullable
- breaking
  the request property became not nullable
- breaking
  removed the enum value completions of the request property //
- breaking
  removed the enum value high of the request property ////
- breaking
  removed the enum value low of the request property ////
- breaking
  removed the enum value medium of the request property ////
- breaking
  removed subschema #1: Text input subschema #3: Output text from the /////// request property oneOf list
- breaking
  removed subschema #1 subschema #2 from the // request property oneOf list
- breaking
  the //////////// request property format changed from no format to uri
- breaking
  the //// request property type changed from string to no type
- breaking
  response property code list-of-types was widened by adding types null to media type application/json of response 400
- breaking
  response property data_source/oneOf[subschema #2: CompletionsRunDataSource]/source/oneOf[subschema #3: StoredCompletionsRunDataSource]/created_after list-of-types was widened by adding types null to media type application/json of response 201
- breaking
  response property data_source/oneOf[subschema #2: CompletionsRunDataSource]/source/oneOf[subschema #3: StoredCompletionsRunDataSource]/created_before list-of-types was widened by adding types null to media type application/json of response 201
- breaking
  response property data_source/oneOf[subschema #2: CompletionsRunDataSource]/source/oneOf[subschema #3: StoredCompletionsRunDataSource]/limit list-of-types was widened by adding types null to media type application/json of response 201
- breaking
  response property data_source/oneOf[subschema #2: CompletionsRunDataSource]/source/oneOf[subschema #3: StoredCompletionsRunDataSource]/metadata list-of-types was widened by adding types null to media type application/json of response 201
- breaking
  response property data_source/oneOf[subschema #2: CompletionsRunDataSource]/source/oneOf[subschema #3: StoredCompletionsRunDataSource]/model list-of-types was widened by adding types null to media type application/json of response 201
- breaking
  response property data_source/oneOf[subschema #3: ResponsesRunDataSource]/source/oneOf[subschema #3: EvalResponsesSource]/created_after list-of-types was widened by adding types null to media type application/json of response 201
- breaking
  response property data_source/oneOf[subschema #3: ResponsesRunDataSource]/source/oneOf[subschema #3: EvalResponsesSource]/created_before list-of-types was widened by adding types null to media type application/json of response 201
- breaking
  response property data_source/oneOf[subschema #3: ResponsesRunDataSource]/source/oneOf[subschema #3: EvalResponsesSource]/instructions_search list-of-types was widened by adding types null to media type application/json of response 201
- breaking
  response property data_source/oneOf[subschema #3: ResponsesRunDataSource]/source/oneOf[subschema #3: EvalResponsesSource]/metadata list-of-types was widened by adding types null to media type application/json of response 201
- breaking
  response property data_source/oneOf[subschema #3: ResponsesRunDataSource]/source/oneOf[subschema #3: EvalResponsesSource]/model list-of-types was widened by adding types null to media type application/json of response 201
- breaking
  response property data_source/oneOf[subschema #3: ResponsesRunDataSource]/source/oneOf[subschema #3: EvalResponsesSource]/temperature list-of-types was widened by adding types null to media type application/json of response 201
- breaking
  response property data_source/oneOf[subschema #3: ResponsesRunDataSource]/source/oneOf[subschema #3: EvalResponsesSource]/top_p list-of-types was widened by adding types null to media type application/json of response 201
- breaking
  response property data_source/oneOf[subschema #3: ResponsesRunDataSource]/source/oneOf[subschema #3: EvalResponsesSource]/users list-of-types was widened by adding types null to media type application/json of response 201
- breaking
  response property metadata list-of-types was widened by adding types null to media type application/json of response 201
- breaking
  response property param list-of-types was widened by adding types null to media type application/json of response 400
- breaking
  added to the /////// response property oneOf list for the response status
- breaking
  added subschema #1: InputMessagesTemplate subschema #2: InputMessagesItemReference to the // response property oneOf list for the response status
- breaking
  the //// response's property type changed from string to no type for status
- warning
  removed the request property ////
- warning
  removed the request property ////
- warning
  removed the optional property //// from the response with the status
- warning
  removed the optional property //// from the response with the status
- warning
  added the new original enum value to the /////////// response property for the response status
- warning
  added the new responses enum value to the // response property for the response status
- info
  added the new optional request property ///////////
- info
  added the new optional request property ///////////
- info
  added the new optional request property ///////
- info
  added the new optional request property ///
- info
  added the new optional request property ///
- info
  added the new optional request property ///
- info
  added the new optional request property ///
- info
  added the new optional request property ///
- info
  added the new optional request property ///
- info
  added the new optional request property ////
- info
  added subschema #2 to the //// request property anyOf list
- info
  the request property default value changed from completions to responses
- info
  the request property default value medium was removed
- info
  added discriminator to ///////// request property
- info
  added the new original enum value to the request property ///////////
- info
  added the new responses enum value to the request property //
- info
  request property //// list-of-types was widened by adding types null to media type application/json
- info
  request property //// list-of-types was widened by adding types null to media type application/json
- info
  request property //// list-of-types was widened by adding types null to media type application/json
- info
  request property //// list-of-types was widened by adding types null to media type application/json
- info
  request property //// list-of-types was widened by adding types null to media type application/json
- info
  request property //// list-of-types was widened by adding types null to media type application/json
- info
  request property //// list-of-types was widened by adding types null to media type application/json
- info
  request property //// list-of-types was widened by adding types null to media type application/json
- info
  request property //// list-of-types was widened by adding types null to media type application/json
- info
  request property //// list-of-types was widened by adding types null to media type application/json
- info
  request property //// list-of-types was widened by adding types null to media type application/json
- info
  request property //// list-of-types was widened by adding types null to media type application/json
- info
  request property //// list-of-types was widened by adding types null to media type application/json
- info
  request property list-of-types was widened by adding types null to media type application/json
- info
  added to the /////// request property oneOf list
- info
  added subschema #1: InputMessagesTemplate subschema #2: InputMessagesItemReference to the // request property oneOf list
- info
  added the optional property /////////// to the response with the status
- info
  added the optional property /////////// to the response with the status
- info
  added the optional property /////// to the response with the status
- info
  added the optional property /// to the response with the status
- info
  added the optional property /// to the response with the status
- info
  added the optional property /// to the response with the status
- info
  added the optional property /// to the response with the status
- info
  added the optional property /// to the response with the status
- info
  added the optional property /// to the response with the status
- info
  added the optional property //// to the response with the status
- info
  added subschema #2 to the //// response property anyOf list for the response status
- info
  the response's property default value changed from completions to responses for the status
- info
  the response's property default value medium was removed for the status
- info
  added discriminator to ///////// response property for the response status
- info
  removed the completions enum value from the // response property for the response status
- info
  removed the high enum value from the //// response property for the response status
- info
  removed the low enum value from the //// response property for the response status
- info
  removed the medium enum value from the //// response property for the response status
- info
  removed subschema #1: Text input subschema #3: Output text from the /////// response property oneOf list for the response status
- info
  removed subschema #1 subschema #2 from the // response property oneOf list for the response status
May 7, 2026737fbb7f6f17 Revision changes
- breaking
  removed the enum value 1024x1024 of the request property //////
- breaking
  removed the enum value 1024x1536 of the request property //////
- breaking
  removed the enum value 1536x1024 of the request property //////
- breaking
  removed the enum value auto of the request property //////
- warning
  added the new chatgpt-image-latest enum value to the /////// response property for the response status
- warning
  added the new gpt-image-2 enum value to the /////// response property for the response status
- warning
  added the new gpt-image-2-2026-04-21 enum value to the /////// response property for the response status
- info
  added the new chatgpt-image-latest enum value to the request property ///////
- info
  added the new gpt-image-2 enum value to the request property ///////
- info
  added the new gpt-image-2-2026-04-21 enum value to the request property ///////
- info
  removed the 1024x1024 enum value from the ////// response property for the response status
- info
  removed the 1024x1536 enum value from the ////// response property for the response status
- info
  removed the 1536x1024 enum value from the ////// response property for the response status
- info
  removed the auto enum value from the ////// response property for the response status
May 6, 20261b5c6501b847 Revision changes
- breaking
  the ////// request property type changed from string to no type
- breaking
  the ////// response's property type changed from string to no type for status
- info
  added subschema #1 subschema #2 to the ////// request property anyOf list
- info
  added subschema #1 subschema #2 to the ////// response property anyOf list for the response status
May 4, 202664494d56c425 Revision changes
- breaking
  the //////////// request property format changed from no format to uri
- breaking
  the /////////// request property format changed from no format to uri
Apr 29, 20265b98524f8dee Revision changes
- breaking
  the ////////// request property format changed from no format to uri
- breaking
  the /////////// request property format changed from no format to uri
- breaking
  the ////////// request property format changed from no format to uri
- breaking
  the /////////// request property format changed from no format to uri
- breaking
  the ////// request property format changed from no format to uri
Apr 10, 20267c540cce6eb3 Revision changes
- breaking
  the request property became not nullable
- breaking
  removed from the request property oneOf list
- breaking
  response property code list-of-types was widened by adding types null to media type application/json of response 400
- breaking
  response property metadata list-of-types was widened by adding types null to media type application/json of response 201
- breaking
  response property param list-of-types was widened by adding types null to media type application/json of response 400
- info
  added to the request property anyOf list
- info
  request property list-of-types was widened by adding types null to media type application/json
- info
  added to the response property anyOf list for the response status
- info
  added discriminator to response property for the response status
- info
  removed from the response property oneOf list for the response status
Apr 29, 20256a6c681b1820 Revision changes
- info
  endpoint added