ORoroagents
public

Get evaluation run details

Changed on

Get detailed information about a specific evaluation run.

get/v1/public/evaluation-runs/{eval_run_id}

Request

Path parameters

eval_run_idstring uuid required

Evaluation run ID

Response

Successful Response

eval_run_idstring uuid required

Unique identifier for this run

agent_version_idstring uuid required

Agent version being evaluated

agent_namestring required

Name of the agent

validator_hotkeystring required

Validator performing evaluation

status'CLAIMED' | 'RUNNING' | 'SUCCESS' | 'FAILED' | 'TIMED_OUT' | 'STALE' | 'CANCELLED' required

Status of an evaluation run through its lifecycle.

scorenumber nullable

Score if completed successfully

version_numberinteger required

Version number within this agent (v1, v2, etc.)

claimed_atstring date-time required

When the run was claimed

completed_atstring date-time nullable

When the run completed

failure_reasonstring nullable

Validator-reported failure reason

is_includedboolean

Whether run is included in aggregate scoring

invalidated_atstring date-time nullable

When run was invalidated

invalidation_reasonstring nullable

Reason for invalidation

sandbox_metadataobject nullable

Sandbox execution details

inference_failure_countinteger nullable

Number of failed miner inference calls

inference_totalinteger nullable

Total number of miner inference calls

score_components_summaryobject nullable

Score breakdown including reasoning details

execution_kind'legacy_shoppingbench' | 'envpack'

Changes

  • ccc7255acda3Revision changes
    • breaking

      removed the required property // from the response with the status

    • warning

      removed the optional property from the response with the status

  • 43262371e0c1Revision changes
    • breaking

      removed the required property // from the response with the status

    • breaking

      removed the required property // from the response with the status