Evals

Get an eval run

Get an evaluation run by ID.

get/evals/{eval_id}/runs/{run_id}

Path parameters

eval_idstring required

The ID of the evaluation to retrieve runs for.

run_idstring required

The ID of the run to retrieve.

Response

The evaluation run

object'eval.run' required

The type of the object. Always "eval.run".

idstring required

Unique identifier for the evaluation run.

eval_idstring required

The identifier of the associated evaluation.

statusstring required

The status of the evaluation run.

modelstring required

The model that is evaluated, if applicable.

namestring required

The name of the evaluation run.

created_atinteger required

Unix timestamp (in seconds) when the evaluation run was created.

report_urlstring uri required

The URL to the rendered evaluation run report on the UI dashboard.

metadataMetadata nullable required

Set of 16 key-value pairs that can be attached to an object. This can be useful for storing additional information about the object in a structured format, and querying for objects via API or the dashboard.

Keys are strings with a maximum length of 64 characters. Values are strings with a maximum length of 512 characters.

Changes

Changed in 4 of the 31 revisions of this API.1724

Jul 9, 2026e0508a503b84418See the full diff
- ●
  added the new auto enum value to the data_source/anyOf[subschema #2: CompletionsRunDataSource]/input_messages/anyOf[subschema #1: TemplateInputMessages]/template/items/anyOf[subschema #1: Input message]/content/anyOf[subschema #2: Input item content list]/items/anyOf[subschema #3: Input file]/detail response property for the response status 200
  response-property-enum-value-added
- ●
  added the new max enum value to the data_source/anyOf[subschema #2: CompletionsRunDataSource]/sampling_params/reasoning_effort/anyOf[subschema #1]/ response property for the response status 200
  response-property-enum-value-added
- ●
  added the new max enum value to the data_source/anyOf[subschema #3: CreateEvalResponsesRunDataSource]/sampling_params/reasoning_effort/anyOf[subschema #1]/ response property for the response status 200
  response-property-enum-value-added
- ●
  added the new max enum value to the data_source/anyOf[subschema #3: CreateEvalResponsesRunDataSource]/source/anyOf[subschema #3: EvalResponsesSource]/reasoning_effort/anyOf[ReasoningEffort]/anyOf[subschema #1]/ response property for the response status 200
  response-property-enum-value-added
- ○
  added the optional property data_source/anyOf[subschema #2: CompletionsRunDataSource]/input_messages/anyOf[subschema #1: TemplateInputMessages]/template/items/anyOf[subschema #1: Input message]/content/anyOf[subschema #2: Input item content list]/items/anyOf[subschema #1: Input text]/prompt_cache_breakpoint to the response with the 200 status
  response-optional-property-added
- ○
  added the optional property data_source/anyOf[subschema #2: CompletionsRunDataSource]/input_messages/anyOf[subschema #1: TemplateInputMessages]/template/items/anyOf[subschema #1: Input message]/content/anyOf[subschema #2: Input item content list]/items/anyOf[subschema #2: Input image]/prompt_cache_breakpoint to the response with the 200 status
  response-optional-property-added
- ○
  added the optional property data_source/anyOf[subschema #2: CompletionsRunDataSource]/input_messages/anyOf[subschema #1: TemplateInputMessages]/template/items/anyOf[subschema #1: Input message]/content/anyOf[subschema #2: Input item content list]/items/anyOf[subschema #3: Input file]/prompt_cache_breakpoint to the response with the 200 status
  response-optional-property-added
- ○
  added the optional property data_source/anyOf[subschema #2: CompletionsRunDataSource]/input_messages/anyOf[subschema #1: TemplateInputMessages]/template/items/anyOf[subschema #2: EvalItem]/content/anyOf[subschema #1: Eval content item]/anyOf[subschema #2: Input text]/prompt_cache_breakpoint to the response with the 200 status
  response-optional-property-added
- ○
  added the optional property data_source/anyOf[subschema #2: CompletionsRunDataSource]/input_messages/anyOf[subschema #1: TemplateInputMessages]/template/items/anyOf[subschema #2: EvalItem]/content/anyOf[subschema #2: An array of Input text Output text Input image and Input audio]/items/anyOf[subschema #2: Input text]/prompt_cache_breakpoint to the response with the 200 status
  response-optional-property-added
- ○
  added the optional property data_source/anyOf[subschema #3: CreateEvalResponsesRunDataSource]/input_messages/anyOf[subschema #1: InputMessagesTemplate]/template/items/anyOf[subschema #2: EvalItem]/content/anyOf[subschema #1: Eval content item]/anyOf[subschema #2: Input text]/prompt_cache_breakpoint to the response with the 200 status
  response-optional-property-added
- ○
  added the optional property data_source/anyOf[subschema #3: CreateEvalResponsesRunDataSource]/input_messages/anyOf[subschema #1: InputMessagesTemplate]/template/items/anyOf[subschema #2: EvalItem]/content/anyOf[subschema #2: An array of Input text Output text Input image and Input audio]/items/anyOf[subschema #2: Input text]/prompt_cache_breakpoint to the response with the 200 status
  response-optional-property-added
- ○
  added the optional property data_source/anyOf[subschema #3: CreateEvalResponsesRunDataSource]/sampling_params/tools/items/anyOf[subschema #10: Shell tool -> subschema #11: Shell tool]/allowed_callers to the response with the 200 status
  response-optional-property-added
- ○
  added the optional property data_source/anyOf[subschema #3: CreateEvalResponsesRunDataSource]/sampling_params/tools/items/anyOf[subschema #11: Custom tool -> subschema #12: Custom tool]/allowed_callers to the response with the 200 status
  response-optional-property-added
- ○
  added the optional property data_source/anyOf[subschema #3: CreateEvalResponsesRunDataSource]/sampling_params/tools/items/anyOf[subschema #12: Namespace -> subschema #13: Namespace]/tools/items/anyOf[FunctionToolParam]/allowed_callers to the response with the 200 status
  response-optional-property-added
- ○
  added the optional property data_source/anyOf[subschema #3: CreateEvalResponsesRunDataSource]/sampling_params/tools/items/anyOf[subschema #12: Namespace -> subschema #13: Namespace]/tools/items/anyOf[FunctionToolParam]/output_schema to the response with the 200 status
  response-optional-property-added
- ○
  added the optional property data_source/anyOf[subschema #3: CreateEvalResponsesRunDataSource]/sampling_params/tools/items/anyOf[subschema #12: Namespace -> subschema #13: Namespace]/tools/items/anyOf[subschema #2: Custom tool]/allowed_callers to the response with the 200 status
  response-optional-property-added
- ○
  added the optional property data_source/anyOf[subschema #3: CreateEvalResponsesRunDataSource]/sampling_params/tools/items/anyOf[subschema #15: Apply patch tool -> subschema #16: Apply patch tool]/allowed_callers to the response with the 200 status
  response-optional-property-added
- ○
  added the optional property data_source/anyOf[subschema #3: CreateEvalResponsesRunDataSource]/sampling_params/tools/items/anyOf[subschema #1: Function]/allowed_callers to the response with the 200 status
  response-optional-property-added
- ○
  added the optional property data_source/anyOf[subschema #3: CreateEvalResponsesRunDataSource]/sampling_params/tools/items/anyOf[subschema #1: Function]/output_schema to the response with the 200 status
  response-optional-property-added
- ○
  added the optional property data_source/anyOf[subschema #3: CreateEvalResponsesRunDataSource]/sampling_params/tools/items/anyOf[subschema #6: MCP tool]/allowed_callers to the response with the 200 status
  response-optional-property-added
- ○
  added the optional property data_source/anyOf[subschema #3: CreateEvalResponsesRunDataSource]/sampling_params/tools/items/anyOf[subschema #7: Code interpreter]/allowed_callers to the response with the 200 status
  response-optional-property-added
- ○
  added ProgrammaticToolCallingParam to the data_source/anyOf[subschema #3: CreateEvalResponsesRunDataSource]/sampling_params/tools/items/ response property anyOf list for the response status 200
  response-property-any-of-added
This revision also has 1 change that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog
Jun 17, 2026827fa3e74ce91See the full diff
- ○
  added the optional property data_source/anyOf[subschema #3: CreateEvalResponsesRunDataSource]/sampling_params/tools/items/anyOf[subschema #6: MCP tool]/tunnel_id to the response with the 200 status
  response-optional-property-added
May 7, 2026737fbb7f6f1734See the full diff
- ●
  added the new chatgpt-image-latest enum value to the data_source/anyOf[subschema #3: CreateEvalResponsesRunDataSource]/sampling_params/tools/items/anyOf[subschema #8: Image generation tool]/model/anyOf[subschema #2]/ response property for the response status 200
  response-property-enum-value-added
- ●
  added the new gpt-image-2 enum value to the data_source/anyOf[subschema #3: CreateEvalResponsesRunDataSource]/sampling_params/tools/items/anyOf[subschema #8: Image generation tool]/model/anyOf[subschema #2]/ response property for the response status 200
  response-property-enum-value-added
- ●
  added the new gpt-image-2-2026-04-21 enum value to the data_source/anyOf[subschema #3: CreateEvalResponsesRunDataSource]/sampling_params/tools/items/anyOf[subschema #8: Image generation tool]/model/anyOf[subschema #2]/ response property for the response status 200
  response-property-enum-value-added
- ○
  removed the 1024x1024 enum value from the data_source/anyOf[subschema #3: CreateEvalResponsesRunDataSource]/sampling_params/tools/items/anyOf[subschema #8: Image generation tool]/size response property for the response status 200
  response-property-enum-value-removed
- ○
  removed the 1024x1536 enum value from the data_source/anyOf[subschema #3: CreateEvalResponsesRunDataSource]/sampling_params/tools/items/anyOf[subschema #8: Image generation tool]/size response property for the response status 200
  response-property-enum-value-removed
- ○
  removed the 1536x1024 enum value from the data_source/anyOf[subschema #3: CreateEvalResponsesRunDataSource]/sampling_params/tools/items/anyOf[subschema #8: Image generation tool]/size response property for the response status 200
  response-property-enum-value-removed
- ○
  removed the auto enum value from the data_source/anyOf[subschema #3: CreateEvalResponsesRunDataSource]/sampling_params/tools/items/anyOf[subschema #8: Image generation tool]/size response property for the response status 200
  response-property-enum-value-removed
May 6, 20261b5c6501b84711See the full diff
- ▲
  the data_source/anyOf[subschema #3: CreateEvalResponsesRunDataSource]/sampling_params/tools/items/anyOf[subschema #8: Image generation tool]/size response's property type/format changed from string/ to / for status 200
  response-property-type-changed
- ○
  added subschema #1 subschema #2 to the data_source/anyOf[subschema #3: CreateEvalResponsesRunDataSource]/sampling_params/tools/items/anyOf[subschema #8: Image generation tool]/size response property anyOf list for the response status 200
  response-property-any-of-added

Full history