Sign in

Changes to Create Eval

POST /eval

Every recorded change to this endpoint, newest first. Back to the operation

Changed in 10 of the 57 revisions of this API.9577

  1. 57c22d5b351033
  2. 45678bc2c66345
  3. 43f0c6f3dcfb6
  4. acbf00c4a7f911
  5. 8474b743bad6112
  6. 2b9e82960b2b21
  7. 61bab830871d1
  8. b66bf0e7c5d01
  9. 61bab830871d4
  10. ee300291d26b1

What changed

  • 57c22d5b351033See the full diff
    • ●

      added the new gemini-3-flash-preview enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[AssistantMessageJudgePlanAI]/model/oneOf[subschema #3: EvalGoogleModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gemini-3-flash-preview enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #3: EvalGoogleModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gemini-3-flash-preview enum value to the messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #3: EvalGoogleModel]/model response property for the response status 201

      response-property-enum-value-added

    • ○

      added the new gemini-3-flash-preview enum value to the request property messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[AssistantMessageJudgePlanAI]/model/oneOf[subschema #3: EvalGoogleModel]/model

      request-property-enum-value-added

    • ○

      added the new gemini-3-flash-preview enum value to the request property messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #3: EvalGoogleModel]/model

      request-property-enum-value-added

    • ○

      added the new gemini-3-flash-preview enum value to the request property messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #3: EvalGoogleModel]/model

      request-property-enum-value-added

  • 45678bc2c66345See the full diff
    • ●

      added the new gpt-4.1-2025-04-14:germanywestcentral enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4.1-2025-04-14:germanywestcentral enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4.1-2025-04-14:germanywestcentral enum value to the messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4.1-2025-04-14:polandcentral enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4.1-2025-04-14:polandcentral enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4.1-2025-04-14:polandcentral enum value to the messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4.1-2025-04-14:spaincentral enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4.1-2025-04-14:spaincentral enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4.1-2025-04-14:spaincentral enum value to the messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4.1-2025-04-14:westeurope enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4.1-2025-04-14:westeurope enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4.1-2025-04-14:westeurope enum value to the messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4.1-mini-2025-04-14:germanywestcentral enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4.1-mini-2025-04-14:germanywestcentral enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4.1-mini-2025-04-14:germanywestcentral enum value to the messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4.1-mini-2025-04-14:polandcentral enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4.1-mini-2025-04-14:polandcentral enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4.1-mini-2025-04-14:polandcentral enum value to the messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4.1-mini-2025-04-14:spaincentral enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4.1-mini-2025-04-14:spaincentral enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4.1-mini-2025-04-14:spaincentral enum value to the messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4.1-mini-2025-04-14:westeurope enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4.1-mini-2025-04-14:westeurope enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4.1-mini-2025-04-14:westeurope enum value to the messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4o-2024-11-20:germanywestcentral enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4o-2024-11-20:germanywestcentral enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4o-2024-11-20:germanywestcentral enum value to the messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4o-2024-11-20:polandcentral enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4o-2024-11-20:polandcentral enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4o-2024-11-20:polandcentral enum value to the messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4o-2024-11-20:spaincentral enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4o-2024-11-20:spaincentral enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4o-2024-11-20:spaincentral enum value to the messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4o-2024-11-20:westeurope enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4o-2024-11-20:westeurope enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-4o-2024-11-20:westeurope enum value to the messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-5-chat-latest enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-5-chat-latest enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-5-chat-latest enum value to the messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-5.2 enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-5.2 enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-5.2 enum value to the messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-5.2-chat-latest enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-5.2-chat-latest enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-5.2-chat-latest enum value to the messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    This revision's changelog hit the recording limit, so it may not list every change to this endpoint.

  • 43f0c6f3dcfb6See the full diff
    • ●

      added the new gpt-5.1 enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-5.1 enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-5.1 enum value to the messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-5.1-chat-latest enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/allOf[AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-5.1-chat-latest enum value to the messages/items/oneOf[subschema #4: ChatEvalToolResponseMessageEvaluation]/judgePlan/oneOf[subschema #1: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    • ●

      added the new gpt-5.1-chat-latest enum value to the messages/items/oneOf[subschema #6: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #1: EvalOpenAIModel]/model response property for the response status 201

      response-property-enum-value-added

    This revision's changelog hit the recording limit, so it may not list every change to this endpoint.

  • acbf00c4a7f911See the full diff
    • ▲

      added ChatEvalToolResponseMessageEvaluation to the messages/items/ response property oneOf list for the response status 201

      response-property-one-of-added

    • ○

      added ChatEvalToolResponseMessageEvaluation to the messages/items/ request property oneOf list

      request-property-one-of-added

  • 8474b743bad6112See the full diff
    • ▲

      the description response property's minLength was decreased from 1 to 0 for the response status 201

      response-property-min-length-decreased

    • ●

      added the new claude-haiku-4-5-20251001 enum value to the messages/items/oneOf[subschema #5: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #2: EvalAnthropicModel]/model response property for the response status 201

      response-property-enum-value-added

    • ○

      added the new claude-haiku-4-5-20251001 enum value to the request property messages/items/oneOf[subschema #5: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #2: EvalAnthropicModel]/model

      request-property-enum-value-added

    • ○

      the description request property's minLength was decreased from 1 to 0

      request-property-min-length-decreased

  • 2b9e82960b2b21See the full diff
    • ▲

      the messages/items/oneOf[subschema #2: ChatEvalSystemMessageMock]/content response property's maxLength was unset from 100000000 for the response status 201

      response-property-max-length-unset

    • ▲

      the messages/items/oneOf[subschema #3: ChatEvalToolResponseMessageMock]/content response property's maxLength was unset from 1000 for the response status 201

      response-property-max-length-unset

    • ●

      added the new claude-sonnet-4-5-20250929 enum value to the messages/items/oneOf[subschema #5: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #2: EvalAnthropicModel]/model response property for the response status 201

      response-property-enum-value-added

    This revision's changelog hit the recording limit, so it may not list every change to this endpoint.

    This revision also has 3 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog

  • 61bab830871d1See the full diff
    • ▲

      removed the enum value claude-sonnet-4-5-20250929 of the request property messages/items/oneOf[subschema #5: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #2: EvalAnthropicModel]/model

      request-property-enum-value-removed

    This revision's changelog hit the recording limit, so it may not list every change to this endpoint.

  • b66bf0e7c5d01See the full diff
    • ●

      added the new claude-sonnet-4-5-20250929 enum value to the messages/items/oneOf[subschema #5: ChatEvalAssistantMessageEvaluation]/judgePlan/oneOf[subschema #3: AssistantMessageJudgePlanAI]/model/oneOf[subschema #2: EvalAnthropicModel]/model response property for the response status 201

      response-property-enum-value-added

    This revision's changelog hit the recording limit, so it may not list every change to this endpoint.

    This revision also has 2 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog

  • 61bab830871d4See the full diff
    • ▲

      added the new required request property messages

      new-required-request-property

    • ▲

      added the new required request property type

      new-required-request-property

    • ▲

      removed CreateEvalDTO from the request body oneOf list

      request-body-one-of-removed

    • ▲

      the request's body type/format changed from / to object/

      request-body-type-changed

    This revision's changelog hit the recording limit, so it may not list every change to this endpoint.

  • ee300291d26b1See the full diff
    • ○

      endpoint added

      endpoint-added

Of the 57 revisions, 2 have no diff computed and 9 have a changelog that could not be searched.