Eval Runs

List Eval Runs

List all eval runs, with optional filtering.

Args: eval_uuid (str, optional): UUID of the eval to filter runs by. Defaults to None. workspace_uuid (str, optional): UUID of the workspace. Use "*" for enterprise-wide access, omit for user's current workspace. Defaults to None.

Returns: list[EvalRunResult]: List of eval runs matching the filters.

Raises: AymaraAPIError: If the organization is missing.

Example: GET /api/eval-runs?eval_uuid=...&workspace_uuid=...

get/v2/eval-runs

Query parameters

eval_uuidstring

workspace_uuidstring

limitinteger

offsetinteger

Response

countinteger required

Changes

Changed in 13 of the 25 revisions of this API.51128

Nov 20, 20250cb64ef11adf2See the full diff
- ▲
  removed the required property items/items/evaluation/anyOf[subschema #1: Eval]/ai_instructions/anyOf[subschema #2: AgentInstructions]/tools/oneOf[subschema #1: ToolArray]/value/items/id from the response with the 200 status
  response-required-property-removed
- ▲
  removed the required property items/items/evaluation/anyOf[subschema #1: Eval]/ai_instructions/anyOf[subschema #3: WorkflowInstructions]/instructions/items/tools/oneOf[subschema #1: ToolArray]/value/items/id from the response with the 200 status
  response-required-property-removed
Nov 19, 2025cd49adceebf82See the full diff
- ○
  added subschema #1 subschema #4 to the items/items/evaluation/anyOf[subschema #1: Eval]/ai_instructions response property anyOf list for the response status 200
  response-property-any-of-added
- ○
  removed subschema #1 subschema #4 from the items/items/evaluation/anyOf[subschema #1: Eval]/ai_instructions response property anyOf list for the response status 200
  response-property-any-of-removed
Nov 19, 20250b43b7bedf322See the full diff
- ○
  added the optional property items/items/evaluation/anyOf[subschema #1: Eval]/ai_instructions/anyOf[subschema #2: AgentInstructions]/agent_name to the response with the 200 status
  response-optional-property-added
- ○
  added WorkflowInstructions to the items/items/evaluation/anyOf[subschema #1: Eval]/ai_instructions response property anyOf list for the response status 200
  response-property-any-of-added
Nov 17, 20251af31c95d91a12See the full diff
- ▲
  added ToolArray ToolDict ToolString to the items/items/evaluation/anyOf[subschema #1: Eval]/ai_instructions/anyOf[subschema #2: AgentInstructions]/tools response property oneOf list for the response status 200
  response-property-one-of-added
- ○
  removed ToolsList ToolDict ToolsString from the items/items/evaluation/anyOf[subschema #1: Eval]/ai_instructions/anyOf[subschema #2: AgentInstructions]/tools response property anyOf list for the response status 200
  response-property-any-of-removed
- ○
  added discriminator to items/items/evaluation/anyOf[subschema #1: Eval]/ai_instructions/anyOf[subschema #2: AgentInstructions]/tools response property for the response status 200
  response-property-discriminator-added
This revision also has 2 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog
Nov 16, 2025d950d722e2302See the full diff
- ○
  added subschema #1 subschema #3 to the items/items/evaluation/anyOf[subschema #1: Eval]/ai_instructions/anyOf[subschema #2: AgentInstructions]/tools response property anyOf list for the response status 200
  response-property-any-of-added
- ○
  removed subschema #1 subschema #3 from the items/items/evaluation/anyOf[subschema #1: Eval]/ai_instructions/anyOf[subschema #2: AgentInstructions]/tools response property anyOf list for the response status 200
  response-property-any-of-removed
Nov 13, 20259f42371cf19a4See the full diff
- ○
  added the optional property items/items/responses/anyOf[subschema #1]/items/manually_updated to the response with the 200 status
  response-optional-property-added
- ○
  added the optional property items/items/responses/anyOf[subschema #1]/items/manually_updated_at to the response with the 200 status
  response-optional-property-added
- ○
  added the optional property items/items/responses/anyOf[subschema #1]/items/manually_updated_by to the response with the 200 status
  response-optional-property-added
- ○
  added the optional property items/items/responses/anyOf[subschema #1]/items/update_history to the response with the 200 status
  response-optional-property-added
Nov 4, 202533b4b8e9d2ce2See the full diff
- ○
  added subschema #1 to the items/items/evaluation/anyOf[subschema #1: Eval]/ai_instructions/anyOf[subschema #2: AgentInstructions]/tools response property anyOf list for the response status 200
  response-property-any-of-added
- ○
  removed subschema #2 from the items/items/evaluation/anyOf[subschema #1: Eval]/ai_instructions/anyOf[subschema #2: AgentInstructions]/tools response property anyOf list for the response status 200
  response-property-any-of-removed
Nov 3, 2025b824d75fc3cb1See the full diff
- ○
  added AgentInstructions to the items/items/evaluation/anyOf[subschema #1: Eval]/ai_instructions response property anyOf list for the response status 200
  response-property-any-of-added
Oct 29, 20259b529d67a7d0115See the full diff
- ●
  added the new auth.workspace_required enum value to the error/code response property for the response status 400
  response-property-enum-value-added
- ●
  added the new auth.workspace_required enum value to the error/code response property for the response status 401
  response-property-enum-value-added
- ●
  added the new auth.workspace_required enum value to the error/code response property for the response status 403
  response-property-enum-value-added
- ●
  added the new auth.workspace_required enum value to the error/code response property for the response status 404
  response-property-enum-value-added
- ●
  added the new auth.workspace_required enum value to the error/code response property for the response status 409
  response-property-enum-value-added
- ●
  added the new auth.workspace_required enum value to the error/code response property for the response status 422
  response-property-enum-value-added
- ●
  added the new auth.workspace_required enum value to the error/code response property for the response status 429
  response-property-enum-value-added
- ●
  added the new auth.workspace_required enum value to the error/code response property for the response status 500
  response-property-enum-value-added
- ●
  added the new auth.workspace_required enum value to the error/code response property for the response status 503
  response-property-enum-value-added
- ●
  added the new video enum value to the items/items/evaluation/anyOf[subschema #1: Eval]/modality/allOf[subschema #1: ContentType]/ response property for the response status 200
  response-property-enum-value-added
- ●
  added the new video enum value to the items/items/responses/anyOf[subschema #1]/items/content_type/allOf[subschema #1: ContentType]/ response property for the response status 200
  response-property-enum-value-added
- ○
  added the optional property items/items/eval_run_examples to the response with the 200 status
  response-optional-property-added
- ○
  added the optional property items/items/evaluation/anyOf[subschema #1: Eval]/created_by to the response with the 200 status
  response-optional-property-added
- ○
  added the optional property items/items/evaluation/anyOf[subschema #1: Eval]/ground_truth/anyOf[subschema #2: FileReference]/file_uuid to the response with the 200 status
  response-optional-property-added
- ○
  added the optional property items/items/is_sandbox to the response with the 200 status
  response-optional-property-added
- ○
  added the optional property items/items/responses/anyOf[subschema #1]/items/content/anyOf[subschema #2: FileReference]/file_uuid to the response with the 200 status
  response-optional-property-added
May 6, 202539873621da545See the full diff
- ○
  the num_prompts response's property default value changed from 50 to 100 for the status 200
  response-property-default-value-changed
- ○
  removed the audio enum value from the items/items/evaluation/anyOf[subschema #1: Eval]/modality/allOf[subschema #1: ContentType]/ response property for the response status 200
  response-property-enum-value-removed
- ○
  removed the audio enum value from the items/items/responses/anyOf[subschema #1]/items/content_type/allOf[subschema #1: ContentType]/ response property for the response status 200
  response-property-enum-value-removed
- ○
  removed the video enum value from the items/items/evaluation/anyOf[subschema #1: Eval]/modality/allOf[subschema #1: ContentType]/ response property for the response status 200
  response-property-enum-value-removed
- ○
  removed the video enum value from the items/items/responses/anyOf[subschema #1]/items/content_type/allOf[subschema #1: ContentType]/ response property for the response status 200
  response-property-enum-value-removed

Full history (13 revisions)