benchmarks

Get Benchmark Task Outcomes

Changed on

Task outcomes across every valid training and evaluation run of this benchmark, independent of task split. Counts and mean rewards exclude execution errors from completed outcomes; ungraded completed attempts remain unscored.

get/api/v1/benchmarks/{bench_id}/task-outcomes

Request

  • Base URL
    https://api.trajectory.ai (the document declares no server; this is the origin it was published from)
  • URL
    https://api.trajectory.ai/api/v1/benchmarks/{bench_id}/task-outcomes
  • Auth
    none declared

Path parameters

bench_idstring required

Query parameters

task_idstring[] required
include_recent_trajectoriesboolean

Include each task's 10 most recent trajectories, newest first, and every trajectory counted by outcome.

string[]
OR
string

Response

Successful Response

Changes

    • info

      query request parameter run_id list-of-types was widened by adding types array

    • info

      added the new optional query request parameter include_recent_trajectories

    • info

      added the new optional query request parameter run_id

    • info

      added the optional property // to the response with the status

    • info

      added the optional property // to the response with the status