Changes to Create Eval Run

Changed in 13 of the 25 revisions of this API.▲7●11○30

1. Nov 20, 20250cb64ef11adf▲2
2. Nov 19, 2025cd49adceebf8○2
3. Nov 19, 20250b43b7bedf32○2
4. Nov 17, 20251af31c95d91a▲1○2
5. Nov 16, 2025d950d722e230○2
6. Nov 13, 20259f42371cf19a○4
7. Nov 4, 202533b4b8e9d2ce○2
8. Nov 3, 2025b824d75fc3cb○1
9. Oct 29, 20259b529d67a7d0●11○7
10. May 6, 202539873621da54▲2○5
11. May 5, 202513afcad941fd▲2
12. Apr 21, 2025934bf6ad4a6b○1
13. Apr 21, 20254948fe9c3752○2

What changed

• Nov 20, 20250cb64ef11adf▲2See the full diff
  • ▲

    removed the required property evaluation/anyOf[subschema #1: Eval]/ai_instructions/anyOf[subschema #2: AgentInstructions]/tools/oneOf[subschema #1: ToolArray]/value/items/id from the response with the 200 status

    response-required-property-removed

  • ▲

    removed the required property evaluation/anyOf[subschema #1: Eval]/ai_instructions/anyOf[subschema #3: WorkflowInstructions]/instructions/items/tools/oneOf[subschema #1: ToolArray]/value/items/id from the response with the 200 status

    response-required-property-removed

• Nov 19, 2025cd49adceebf8○2See the full diff
  • ○

    added subschema #1 subschema #4 to the evaluation/anyOf[subschema #1: Eval]/ai_instructions response property anyOf list for the response status 200

    response-property-any-of-added

  • ○

    removed subschema #1 subschema #4 from the evaluation/anyOf[subschema #1: Eval]/ai_instructions response property anyOf list for the response status 200

    response-property-any-of-removed

• Nov 19, 20250b43b7bedf32○2See the full diff
  • ○

    added the optional property evaluation/anyOf[subschema #1: Eval]/ai_instructions/anyOf[subschema #2: AgentInstructions]/agent_name to the response with the 200 status

    response-optional-property-added

  • ○

    added WorkflowInstructions to the evaluation/anyOf[subschema #1: Eval]/ai_instructions response property anyOf list for the response status 200

    response-property-any-of-added

• Nov 17, 20251af31c95d91a▲1○2See the full diff
  • ▲

    added ToolArray ToolDict ToolString to the evaluation/anyOf[subschema #1: Eval]/ai_instructions/anyOf[subschema #2: AgentInstructions]/tools response property oneOf list for the response status 200

    response-property-one-of-added

  • ○

    removed ToolsList ToolDict ToolsString from the evaluation/anyOf[subschema #1: Eval]/ai_instructions/anyOf[subschema #2: AgentInstructions]/tools response property anyOf list for the response status 200

    response-property-any-of-removed

  • ○

    added discriminator to evaluation/anyOf[subschema #1: Eval]/ai_instructions/anyOf[subschema #2: AgentInstructions]/tools response property for the response status 200

    response-property-discriminator-added

  This revision also has 2 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog

• Nov 16, 2025d950d722e230○2See the full diff
  • ○

    added subschema #1 subschema #3 to the evaluation/anyOf[subschema #1: Eval]/ai_instructions/anyOf[subschema #2: AgentInstructions]/tools response property anyOf list for the response status 200

    response-property-any-of-added

  • ○

    removed subschema #1 subschema #3 from the evaluation/anyOf[subschema #1: Eval]/ai_instructions/anyOf[subschema #2: AgentInstructions]/tools response property anyOf list for the response status 200

    response-property-any-of-removed

• Nov 13, 20259f42371cf19a○4See the full diff
  • ○

    added the optional property responses/anyOf[subschema #1]/items/manually_updated to the response with the 200 status

    response-optional-property-added

  • ○

    added the optional property responses/anyOf[subschema #1]/items/manually_updated_at to the response with the 200 status

    response-optional-property-added

  • ○

    added the optional property responses/anyOf[subschema #1]/items/manually_updated_by to the response with the 200 status

    response-optional-property-added

  • ○

    added the optional property responses/anyOf[subschema #1]/items/update_history to the response with the 200 status

    response-optional-property-added

• Nov 4, 202533b4b8e9d2ce○2See the full diff
  • ○

    added subschema #1 to the evaluation/anyOf[subschema #1: Eval]/ai_instructions/anyOf[subschema #2: AgentInstructions]/tools response property anyOf list for the response status 200

    response-property-any-of-added

  • ○

    removed subschema #2 from the evaluation/anyOf[subschema #1: Eval]/ai_instructions/anyOf[subschema #2: AgentInstructions]/tools response property anyOf list for the response status 200

    response-property-any-of-removed

• Nov 3, 2025b824d75fc3cb○1See the full diff
  • ○

    added AgentInstructions to the evaluation/anyOf[subschema #1: Eval]/ai_instructions response property anyOf list for the response status 200

    response-property-any-of-added

• Oct 29, 20259b529d67a7d0●11○7See the full diff
  • ●

    added the new auth.workspace_required enum value to the error/code response property for the response status 400

    response-property-enum-value-added

  • ●

    added the new auth.workspace_required enum value to the error/code response property for the response status 401

    response-property-enum-value-added

  • ●

    added the new auth.workspace_required enum value to the error/code response property for the response status 403

    response-property-enum-value-added

  • ●

    added the new auth.workspace_required enum value to the error/code response property for the response status 404

    response-property-enum-value-added

  • ●

    added the new auth.workspace_required enum value to the error/code response property for the response status 409

    response-property-enum-value-added

  • ●

    added the new auth.workspace_required enum value to the error/code response property for the response status 422

    response-property-enum-value-added

  • ●

    added the new auth.workspace_required enum value to the error/code response property for the response status 429

    response-property-enum-value-added

  • ●

    added the new auth.workspace_required enum value to the error/code response property for the response status 500

    response-property-enum-value-added

  • ●

    added the new auth.workspace_required enum value to the error/code response property for the response status 503

    response-property-enum-value-added

  • ●

    added the new video enum value to the evaluation/anyOf[subschema #1: Eval]/modality/allOf[subschema #1: ContentType]/ response property for the response status 200

    response-property-enum-value-added

  • ●

    added the new video enum value to the responses/anyOf[subschema #1]/items/content_type/allOf[subschema #1: ContentType]/ response property for the response status 200

    response-property-enum-value-added

  • ○

    added the new optional request property responses/items/content/anyOf[subschema #2: FileReference]/file_uuid

    new-optional-request-property

  • ○

    added the new video enum value to the request property responses/items/content_type/allOf[subschema #1: ContentType]/

    request-property-enum-value-added

  • ○

    added the optional property eval_run_examples to the response with the 200 status

    response-optional-property-added

  • ○

    added the optional property evaluation/anyOf[subschema #1: Eval]/created_by to the response with the 200 status

    response-optional-property-added

  • ○

    added the optional property evaluation/anyOf[subschema #1: Eval]/ground_truth/anyOf[subschema #2: FileReference]/file_uuid to the response with the 200 status

    response-optional-property-added

  • ○

    added the optional property is_sandbox to the response with the 200 status

    response-optional-property-added

  • ○

    added the optional property responses/anyOf[subschema #1]/items/content/anyOf[subschema #2: FileReference]/file_uuid to the response with the 200 status

    response-optional-property-added

• May 6, 202539873621da54▲2○5See the full diff
  • ▲

    removed the enum value audio of the request property responses/items/content_type/allOf[subschema #1: ContentType]/

    request-property-enum-value-removed

  • ▲

    removed the enum value video of the request property responses/items/content_type/allOf[subschema #1: ContentType]/

    request-property-enum-value-removed

  • ○

    the num_prompts response's property default value changed from 50 to 100 for the status 200

    response-property-default-value-changed

  • ○

    removed the audio enum value from the evaluation/anyOf[subschema #1: Eval]/modality/allOf[subschema #1: ContentType]/ response property for the response status 200

    response-property-enum-value-removed

  • ○

    removed the audio enum value from the responses/anyOf[subschema #1]/items/content_type/allOf[subschema #1: ContentType]/ response property for the response status 200

    response-property-enum-value-removed

  • ○

    removed the video enum value from the evaluation/anyOf[subschema #1: Eval]/modality/allOf[subschema #1: ContentType]/ response property for the response status 200

    response-property-enum-value-removed

  • ○

    removed the video enum value from the responses/anyOf[subschema #1]/items/content_type/allOf[subschema #1: ContentType]/ response property for the response status 200

    response-property-enum-value-removed

• May 5, 202513afcad941fd▲2See the full diff
  • ▲

    the response property evaluation/anyOf[subschema #1: Eval]/name became optional for the status 200

    response-property-became-optional

  • ▲

    response property evaluation/anyOf[subschema #1: Eval]/name list-of-types was widened by adding types null to media type application/json of response 200

    response-property-list-of-types-widened

• Apr 21, 2025934bf6ad4a6b○1See the full diff
  • ○

    added the optional property evaluation/anyOf[subschema #1: Eval]/ground_truth to the response with the 200 status

    response-optional-property-added

• Apr 21, 20254948fe9c3752○2See the full diff
  • ○

    added the optional property name to the response with the 200 status

    response-optional-property-added

  • ○

    added the required property eval_uuid to the response with the 200 status

    response-required-property-added