benchmarks

Benchmark Task Count

Changed on
get/api/v1/benchmarks/{bench_id}/task-count

Request

  • Base URL
    https://api.trajectory.ai (the document declares no server; this is the origin it was published from)
  • URL
    https://api.trajectory.ai/api/v1/benchmarks/{bench_id}/task-count
  • Auth
    none declared

Path parameters

bench_idstring required

Query parameters

searchstring nullable

Count only tasks whose label, ID, user message, or category contains this text.

split'train' | 'test' | 'unassigned' nullable

Return only tasks in this split; unassigned selects tasks without one.

environment'setup_needed' | 'building' | 'failed' | 'ready' nullable

Return only tasks whose environment needs setup (missing run command or runtime not ready), is building, failed to build, or is ready to run.

Response

Successful Response

bench_idstring required
task_countinteger required

Changes

    • info

      added the enum value ready to the property anyOf[subschema #1]/ of the query request parameter environment

    • info

      added the new optional query request parameter environment

    • info

      added the new optional query request parameter search

    • info

      added the new optional query request parameter split