Changes to Create Eval

POST /v2/evals

Every recorded change to this endpoint, newest first. Back to the operation

Changed in 11 of the 25 revisions of this API.111232

  1. 0cb64ef11adf22
  2. cd49adceebf813
  3. 0b43b7bedf324
  4. 1af31c95d91a24
  5. d950d722e23013
  6. 33b4b8e9d2ce13
  7. b824d75fc3cb2
  8. 9b529d67a7d0105
  9. 39873621da5424
  10. 13afcad941fd22
  11. 934bf6ad4a6b2

What changed

  • 0cb64ef11adf22See the full diff
    • removed the required property ai_instructions/anyOf[subschema #2: AgentInstructions]/tools/oneOf[subschema #1: ToolArray]/value/items/id from the response with the 201 status

      response-required-property-removed

    • removed the required property ai_instructions/anyOf[subschema #3: WorkflowInstructions]/instructions/items/tools/oneOf[subschema #1: ToolArray]/value/items/id from the response with the 201 status

      response-required-property-removed

    • removed the request property ai_instructions/anyOf[subschema #2: AgentInstructions]/tools/oneOf[subschema #1: ToolArray]/value/items/id

      request-property-removed

    • removed the request property ai_instructions/anyOf[subschema #3: WorkflowInstructions]/instructions/items/tools/oneOf[subschema #1: ToolArray]/value/items/id

      request-property-removed

  • cd49adceebf813See the full diff
    • removed subschema #1 subschema #4 from the ai_instructions request property anyOf list

      request-property-any-of-removed

    • added subschema #1 subschema #4 to the ai_instructions request property anyOf list

      request-property-any-of-added

    • added subschema #1 subschema #4 to the ai_instructions response property anyOf list for the response status 201

      response-property-any-of-added

    • removed subschema #1 subschema #4 from the ai_instructions response property anyOf list for the response status 201

      response-property-any-of-removed

    • added the new optional request property ai_instructions/anyOf[subschema #2: AgentInstructions]/agent_name

      new-optional-request-property

    • added WorkflowInstructions to the ai_instructions request property anyOf list

      request-property-any-of-added

    • added the optional property ai_instructions/anyOf[subschema #2: AgentInstructions]/agent_name to the response with the 201 status

      response-optional-property-added

    • added WorkflowInstructions to the ai_instructions response property anyOf list for the response status 201

      response-property-any-of-added

  • 1af31c95d91a24See the full diff
    • removed ToolsList ToolDict ToolsString from the ai_instructions/anyOf[subschema #2: AgentInstructions]/tools request property anyOf list

      request-property-any-of-removed

    • added ToolArray ToolDict ToolString to the ai_instructions/anyOf[subschema #2: AgentInstructions]/tools response property oneOf list for the response status 201

      response-property-one-of-added

    • added discriminator to ai_instructions/anyOf[subschema #2: AgentInstructions]/tools request property

      request-property-discriminator-added

    • added ToolArray ToolDict ToolString to the ai_instructions/anyOf[subschema #2: AgentInstructions]/tools request property oneOf list

      request-property-one-of-added

    • removed ToolsList ToolDict ToolsString from the ai_instructions/anyOf[subschema #2: AgentInstructions]/tools response property anyOf list for the response status 201

      response-property-any-of-removed

    • added discriminator to ai_instructions/anyOf[subschema #2: AgentInstructions]/tools response property for the response status 201

      response-property-discriminator-added

    This revision also has 2 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog

  • d950d722e23013See the full diff
    • removed subschema #1 subschema #3 from the ai_instructions/anyOf[subschema #2: AgentInstructions]/tools request property anyOf list

      request-property-any-of-removed

    • added subschema #1 subschema #3 to the ai_instructions/anyOf[subschema #2: AgentInstructions]/tools request property anyOf list

      request-property-any-of-added

    • added subschema #1 subschema #3 to the ai_instructions/anyOf[subschema #2: AgentInstructions]/tools response property anyOf list for the response status 201

      response-property-any-of-added

    • removed subschema #1 subschema #3 from the ai_instructions/anyOf[subschema #2: AgentInstructions]/tools response property anyOf list for the response status 201

      response-property-any-of-removed

    • removed subschema #2 from the ai_instructions/anyOf[subschema #2: AgentInstructions]/tools request property anyOf list

      request-property-any-of-removed

    • added subschema #1 to the ai_instructions/anyOf[subschema #2: AgentInstructions]/tools request property anyOf list

      request-property-any-of-added

    • added subschema #1 to the ai_instructions/anyOf[subschema #2: AgentInstructions]/tools response property anyOf list for the response status 201

      response-property-any-of-added

    • removed subschema #2 from the ai_instructions/anyOf[subschema #2: AgentInstructions]/tools response property anyOf list for the response status 201

      response-property-any-of-removed

    • added AgentInstructions to the ai_instructions request property anyOf list

      request-property-any-of-added

    • added AgentInstructions to the ai_instructions response property anyOf list for the response status 201

      response-property-any-of-added

  • 9b529d67a7d0105See the full diff
    • added the new auth.workspace_required enum value to the error/code response property for the response status 400

      response-property-enum-value-added

    • added the new auth.workspace_required enum value to the error/code response property for the response status 401

      response-property-enum-value-added

    • added the new auth.workspace_required enum value to the error/code response property for the response status 403

      response-property-enum-value-added

    • added the new auth.workspace_required enum value to the error/code response property for the response status 404

      response-property-enum-value-added

    • added the new auth.workspace_required enum value to the error/code response property for the response status 409

      response-property-enum-value-added

    • added the new auth.workspace_required enum value to the error/code response property for the response status 422

      response-property-enum-value-added

    • added the new auth.workspace_required enum value to the error/code response property for the response status 429

      response-property-enum-value-added

    • added the new auth.workspace_required enum value to the error/code response property for the response status 500

      response-property-enum-value-added

    • added the new auth.workspace_required enum value to the error/code response property for the response status 503

      response-property-enum-value-added

    • added the new video enum value to the modality/allOf[subschema #1: ContentType]/ response property for the response status 201

      response-property-enum-value-added

    • added the new optional request property created_by

      new-optional-request-property

    • added the new optional request property ground_truth/anyOf[subschema #2: FileReference]/file_uuid

      new-optional-request-property

    • added the new video enum value to the request property modality/allOf[subschema #1: ContentType]/

      request-property-enum-value-added

    • added the optional property created_by to the response with the 201 status

      response-optional-property-added

    • added the optional property ground_truth/anyOf[subschema #2: FileReference]/file_uuid to the response with the 201 status

      response-optional-property-added

    • removed the enum value audio of the request property modality/allOf[subschema #1: ContentType]/

      request-property-enum-value-removed

    • removed the enum value video of the request property modality/allOf[subschema #1: ContentType]/

      request-property-enum-value-removed

    • the num_prompts request property default value changed from 50 to 100

      request-property-default-value-changed

    • the num_prompts response's property default value changed from 50 to 100 for the status 201

      response-property-default-value-changed

    • removed the audio enum value from the modality/allOf[subschema #1: ContentType]/ response property for the response status 201

      response-property-enum-value-removed

    • removed the video enum value from the modality/allOf[subschema #1: ContentType]/ response property for the response status 201

      response-property-enum-value-removed

    • the response property name became optional for the status 201

      response-property-became-optional

    • response property name list-of-types was widened by adding types null to media type application/json of response 201

      response-property-list-of-types-widened

    • the request property name became optional

      request-property-became-optional

    • request property name list-of-types was widened by adding types null to media type application/json

      request-property-list-of-types-widened

    • added the new optional request property ground_truth

      new-optional-request-property

    • added the optional property ground_truth to the response with the 201 status

      response-optional-property-added