Changes to Create eval

added the new optional request property testing_criteria/items/oneOf[subschema #1: LabelModelGrader]/input/items/oneOf[subschema #2: Eval message object]/content/oneOf[subschema #1: Eval content item]/oneOf[subschema #2: Input text]/prompt_cache_breakpoint/ttl

added the new optional request property testing_criteria/items/oneOf[subschema #1: LabelModelGrader]/input/items/oneOf[subschema #2: Eval message object]/content/oneOf[subschema #2: An array of Input text, Output text, Input image, and Input audio]/items/oneOf[subschema #2: Input text]/prompt_cache_breakpoint/ttl

added the new optional request property testing_criteria/items/oneOf[subschema #5: ScoreModelGrader]/allOf[subschema #1: ScoreModelGrader]/input/items/content/oneOf[subschema #1: Eval content item]/oneOf[subschema #2: Input text]/prompt_cache_breakpoint/ttl

added the new optional request property testing_criteria/items/oneOf[subschema #5: ScoreModelGrader]/allOf[subschema #1: ScoreModelGrader]/input/items/content/oneOf[subschema #2: An array of Input text, Output text, Input image, and Input audio]/items/oneOf[subschema #2: Input text]/prompt_cache_breakpoint/ttl

added the optional property testing_criteria/items/oneOf[subschema #1: LabelModelGrader]/allOf[subschema #1: LabelModelGrader]/input/items/content/oneOf[subschema #1: Eval content item]/oneOf[subschema #2: Input text]/prompt_cache_breakpoint/ttl to the response with the 201 status

added the optional property testing_criteria/items/oneOf[subschema #1: LabelModelGrader]/allOf[subschema #1: LabelModelGrader]/input/items/content/oneOf[subschema #2: An array of Input text, Output text, Input image, and Input audio]/items/oneOf[subschema #2: Input text]/prompt_cache_breakpoint/ttl to the response with the 201 status

added the optional property testing_criteria/items/oneOf[subschema #5: ScoreModelGrader]/allOf[subschema #1: ScoreModelGrader]/input/items/content/oneOf[subschema #1: Eval content item]/oneOf[subschema #2: Input text]/prompt_cache_breakpoint/ttl to the response with the 201 status

added the optional property testing_criteria/items/oneOf[subschema #5: ScoreModelGrader]/allOf[subschema #1: ScoreModelGrader]/input/items/content/oneOf[subschema #2: An array of Input text, Output text, Input image, and Input audio]/items/oneOf[subschema #2: Input text]/prompt_cache_breakpoint/ttl to the response with the 201 status

added the optional property error/misalignment/review_target to the response with the 400 status

added the optional property error/misalignment/review_target to the response with the 429 status

added the non-success response with the status 400

added the non-success response with the status 429

added the optional property error/misalignment to the response with the 429 status

added the non-success response with the status 429

added the new max enum value to the testing_criteria/items/oneOf[subschema #5: ScoreModelGrader]/allOf[subschema #1: ScoreModelGrader]/sampling_params/reasoning_effort/anyOf[subschema #1] response property for the response status 201

added the new optional request property testing_criteria/items/oneOf[subschema #1: LabelModelGrader]/input/items/oneOf[subschema #2: Eval message object]/content/oneOf[subschema #1: Eval content item]/oneOf[subschema #2: Input text]/prompt_cache_breakpoint

added the new optional request property testing_criteria/items/oneOf[subschema #1: LabelModelGrader]/input/items/oneOf[subschema #2: Eval message object]/content/oneOf[subschema #2: An array of Input text, Output text, Input image, and Input audio]/items/oneOf[subschema #2: Input text]/prompt_cache_breakpoint

added the new optional request property testing_criteria/items/oneOf[subschema #5: ScoreModelGrader]/allOf[subschema #1: ScoreModelGrader]/input/items/content/oneOf[subschema #1: Eval content item]/oneOf[subschema #2: Input text]/prompt_cache_breakpoint

added the new optional request property testing_criteria/items/oneOf[subschema #5: ScoreModelGrader]/allOf[subschema #1: ScoreModelGrader]/input/items/content/oneOf[subschema #2: An array of Input text, Output text, Input image, and Input audio]/items/oneOf[subschema #2: Input text]/prompt_cache_breakpoint

added the new max enum value to the request property testing_criteria/items/oneOf[subschema #5: ScoreModelGrader]/allOf[subschema #1: ScoreModelGrader]/sampling_params/reasoning_effort/anyOf[subschema #1]

added the optional property testing_criteria/items/oneOf[subschema #1: LabelModelGrader]/allOf[subschema #1: LabelModelGrader]/input/items/content/oneOf[subschema #1: Eval content item]/oneOf[subschema #2: Input text]/prompt_cache_breakpoint to the response with the 201 status

added the optional property testing_criteria/items/oneOf[subschema #1: LabelModelGrader]/allOf[subschema #1: LabelModelGrader]/input/items/content/oneOf[subschema #2: An array of Input text, Output text, Input image, and Input audio]/items/oneOf[subschema #2: Input text]/prompt_cache_breakpoint to the response with the 201 status

added the optional property testing_criteria/items/oneOf[subschema #5: ScoreModelGrader]/allOf[subschema #1: ScoreModelGrader]/input/items/content/oneOf[subschema #1: Eval content item]/oneOf[subschema #2: Input text]/prompt_cache_breakpoint to the response with the 201 status

added the optional property testing_criteria/items/oneOf[subschema #5: ScoreModelGrader]/allOf[subschema #1: ScoreModelGrader]/input/items/content/oneOf[subschema #2: An array of Input text, Output text, Input image, and Input audio]/items/oneOf[subschema #2: Input text]/prompt_cache_breakpoint to the response with the 201 status

the testing_criteria response's property default value eval was removed for the status 201

the testing_criteria response's property default value eval was removed for the status 201

added the new max enum value to the testing_criteria/items/oneOf[subschema #5: ScoreModelGrader]/allOf[subschema #1: ScoreModelGrader]/sampling_params/reasoning_effort/anyOf[subschema #1] response property for the response status 201

added the new optional request property testing_criteria/items/oneOf[subschema #1: LabelModelGrader]/input/items/oneOf[subschema #2: Eval message object]/content/oneOf[subschema #1: Eval content item]/oneOf[subschema #2: Input text]/prompt_cache_breakpoint

added the new optional request property testing_criteria/items/oneOf[subschema #1: LabelModelGrader]/input/items/oneOf[subschema #2: Eval message object]/content/oneOf[subschema #2: An array of Input text, Output text, Input image, and Input audio]/items/oneOf[subschema #2: Input text]/prompt_cache_breakpoint

added the new optional request property testing_criteria/items/oneOf[subschema #5: ScoreModelGrader]/allOf[subschema #1: ScoreModelGrader]/input/items/content/oneOf[subschema #1: Eval content item]/oneOf[subschema #2: Input text]/prompt_cache_breakpoint

added the new optional request property testing_criteria/items/oneOf[subschema #5: ScoreModelGrader]/allOf[subschema #1: ScoreModelGrader]/input/items/content/oneOf[subschema #2: An array of Input text, Output text, Input image, and Input audio]/items/oneOf[subschema #2: Input text]/prompt_cache_breakpoint

added the new max enum value to the request property testing_criteria/items/oneOf[subschema #5: ScoreModelGrader]/allOf[subschema #1: ScoreModelGrader]/sampling_params/reasoning_effort/anyOf[subschema #1]

added the optional property testing_criteria/items/oneOf[subschema #1: LabelModelGrader]/allOf[subschema #1: LabelModelGrader]/input/items/content/oneOf[subschema #1: Eval content item]/oneOf[subschema #2: Input text]/prompt_cache_breakpoint to the response with the 201 status

added the optional property testing_criteria/items/oneOf[subschema #1: LabelModelGrader]/allOf[subschema #1: LabelModelGrader]/input/items/content/oneOf[subschema #2: An array of Input text, Output text, Input image, and Input audio]/items/oneOf[subschema #2: Input text]/prompt_cache_breakpoint to the response with the 201 status

added the optional property testing_criteria/items/oneOf[subschema #5: ScoreModelGrader]/allOf[subschema #1: ScoreModelGrader]/input/items/content/oneOf[subschema #1: Eval content item]/oneOf[subschema #2: Input text]/prompt_cache_breakpoint to the response with the 201 status

added the optional property testing_criteria/items/oneOf[subschema #5: ScoreModelGrader]/allOf[subschema #1: ScoreModelGrader]/input/items/content/oneOf[subschema #2: An array of Input text, Output text, Input image, and Input audio]/items/oneOf[subschema #2: Input text]/prompt_cache_breakpoint to the response with the 201 status

added the new max enum value to the testing_criteria/items/anyOf[subschema #5: EvalGraderScoreModel]/allOf[subschema #1: ScoreModelGrader]/sampling_params/reasoning_effort/anyOf[subschema #1] response property for the response status 201

added the new optional request property testing_criteria/items/anyOf[subschema #1: LabelModelGrader]/input/items/anyOf[subschema #2: EvalItem]/content/anyOf[subschema #1: Eval content item]/anyOf[subschema #2: Input text]/prompt_cache_breakpoint

added the new optional request property testing_criteria/items/anyOf[subschema #1: LabelModelGrader]/input/items/anyOf[subschema #2: EvalItem]/content/anyOf[subschema #2: An array of Input text, Output text, Input image, and Input audio]/items/anyOf[subschema #2: Input text]/prompt_cache_breakpoint

added the new optional request property testing_criteria/items/anyOf[subschema #5: EvalGraderScoreModel]/allOf[subschema #1: ScoreModelGrader]/input/items/content/anyOf[subschema #1: Eval content item]/anyOf[subschema #2: Input text]/prompt_cache_breakpoint

added the new optional request property testing_criteria/items/anyOf[subschema #5: EvalGraderScoreModel]/allOf[subschema #1: ScoreModelGrader]/input/items/content/anyOf[subschema #2: An array of Input text, Output text, Input image, and Input audio]/items/anyOf[subschema #2: Input text]/prompt_cache_breakpoint

added the new max enum value to the request property testing_criteria/items/anyOf[subschema #5: EvalGraderScoreModel]/allOf[subschema #1: ScoreModelGrader]/sampling_params/reasoning_effort/anyOf[subschema #1]

added the optional property testing_criteria/items/anyOf[subschema #1: LabelModelGrader]/allOf[subschema #1: LabelModelGrader]/input/items/content/anyOf[subschema #1: Eval content item]/anyOf[subschema #2: Input text]/prompt_cache_breakpoint to the response with the 201 status

added the optional property testing_criteria/items/anyOf[subschema #1: LabelModelGrader]/allOf[subschema #1: LabelModelGrader]/input/items/content/anyOf[subschema #2: An array of Input text, Output text, Input image, and Input audio]/items/anyOf[subschema #2: Input text]/prompt_cache_breakpoint to the response with the 201 status

added the optional property testing_criteria/items/anyOf[subschema #5: EvalGraderScoreModel]/allOf[subschema #1: ScoreModelGrader]/input/items/content/anyOf[subschema #1: Eval content item]/anyOf[subschema #2: Input text]/prompt_cache_breakpoint to the response with the 201 status

added the optional property testing_criteria/items/anyOf[subschema #5: EvalGraderScoreModel]/allOf[subschema #1: ScoreModelGrader]/input/items/content/anyOf[subschema #2: An array of Input text, Output text, Input image, and Input audio]/items/anyOf[subschema #2: Input text]/prompt_cache_breakpoint to the response with the 201 status

the request property metadata became not nullable

removed EvalStringCheckGrader EvalTextSimilarityGrader EvalPythonGrader EvalScoreModelGrader from the testing_criteria/items request property oneOf list

removed InputTextContent subschema #1: Text input subschema #3: Output text from the testing_criteria/items/oneOf[subschema #1: LabelModelGrader]/input/items/oneOf[subschema #2: Eval message object]/content request property oneOf list

response property data_source_config/oneOf[subschema #2: StoredCompletionsDataSourceConfig -> subschema #3: StoredCompletionsDataSourceConfig]/metadata list-of-types was widened by adding types null to media type application/json of response 201

response property metadata list-of-types was widened by adding types null to media type application/json of response 201

added EvalGraderLabelModel EvalGraderStringCheck EvalGraderTextSimilarity EvalGraderPython EvalGraderScoreModel to the testing_criteria/items response property oneOf list for the response status 201

added EvalLogsDataSourceConfig to the data_source_config response property oneOf list for the response status 201

request property metadata list-of-types was widened by adding types null to media type application/json

added CreateEvalStoredCompletionsDataSourceConfig to the data_source_config request property oneOf list

added EvalGraderStringCheck EvalGraderTextSimilarity EvalGraderPython EvalGraderScoreModel to the testing_criteria/items request property oneOf list

added EvalItemContentItem EvalItemContentArray to the testing_criteria/items/oneOf[subschema #1: LabelModelGrader]/input/items/oneOf[subschema #2: Eval message object]/content request property oneOf list

response property data_source_config/oneOf[subschema #2: StoredCompletionsDataSourceConfig -> subschema #3: StoredCompletionsDataSourceConfig]/ deprecated

removed EvalLabelModelGrader EvalStringCheckGrader EvalTextSimilarityGrader EvalPythonGrader EvalScoreModelGrader from the testing_criteria/items response property oneOf list for the response status 201

the testing_criteria/items/anyOf[subschema #1: LabelModelGrader]/input/items/anyOf[subschema #2: EvalItem]/content/anyOf[subschema #1: Eval content item]/anyOf[subschema #4: Input image]/image_url request property format changed from no format to uri

the testing_criteria/items/anyOf[subschema #1: LabelModelGrader]/input/items/anyOf[subschema #2: EvalItem]/content/anyOf[subschema #2: An array of Input text, Output text, Input image, and Input audio]/items/anyOf[subschema #4: Input image]/image_url request property format changed from no format to uri

the testing_criteria/items/anyOf[subschema #5: EvalGraderScoreModel]/allOf[subschema #1: ScoreModelGrader]/input/items/content/anyOf[subschema #1: Eval content item]/anyOf[subschema #4: Input image]/image_url request property format changed from no format to uri

the testing_criteria/items/anyOf[subschema #5: EvalGraderScoreModel]/allOf[subschema #1: ScoreModelGrader]/input/items/content/anyOf[subschema #2: An array of Input text, Output text, Input image, and Input audio]/items/anyOf[subschema #4: Input image]/image_url request property format changed from no format to uri

the request property metadata became not nullable

removed CreateEvalCustomDataSourceConfig CreateEvalLogsDataSourceConfig from the data_source_config request property oneOf list

removed CreateEvalLabelModelGrader EvalStringCheckGrader EvalTextSimilarityGrader EvalPythonGrader EvalScoreModelGrader from the testing_criteria/items request property oneOf list

response property metadata list-of-types was widened by adding types null to media type application/json of response 201

added CreateEvalCustomDataSourceConfig CreateEvalLogsDataSourceConfig CreateEvalStoredCompletionsDataSourceConfig to the data_source_config request property anyOf list

added CreateEvalLabelModelGrader EvalGraderStringCheck EvalGraderTextSimilarity EvalGraderPython EvalGraderScoreModel to the testing_criteria/items request property anyOf list

added discriminator to data_source_config request property

added discriminator to testing_criteria/items request property

request property metadata list-of-types was widened by adding types null to media type application/json

added EvalCustomDataSourceConfig EvalLogsDataSourceConfig EvalStoredCompletionsDataSourceConfig to the data_source_config response property anyOf list for the response status 201

added EvalGraderLabelModel EvalGraderStringCheck EvalGraderTextSimilarity EvalGraderPython EvalGraderScoreModel to the testing_criteria/items response property anyOf list for the response status 201

the testing_criteria response's property default value eval was removed for the status 201

added discriminator to data_source_config response property for the response status 201

removed EvalCustomDataSourceConfig EvalStoredCompletionsDataSourceConfig from the data_source_config response property oneOf list for the response status 201

removed EvalLabelModelGrader EvalStringCheckGrader EvalTextSimilarityGrader EvalPythonGrader EvalScoreModelGrader from the testing_criteria/items response property oneOf list for the response status 201

endpoint added