benchmarks

Ingest Benchmark

Changed on

Validate a benchmark manifest for a bench_id allocated by createBenchmarkUpload, persist it canonically, and write the bench, task, and runtime rows.

post/api/v1/benchmarks/{bench_id}/ingest

Request

  • Base URL
    https://api.trajectory.ai (the document declares no server; this is the origin it was published from)
  • URL
    https://api.trajectory.ai/api/v1/benchmarks/{bench_id}/ingest
  • Auth
    none declared

Path parameters

bench_idstring required

Query parameters

agent_idstring nullable

The benchmark's agent ID. Provide agent_id or agent_name for both new benchmarks and appends.

agent_namestring nullable

The benchmark's agent name. Provide agent_id or agent_name for both new benchmarks and appends.

bench_type'benchmark' | 'holodeck_benchmark'

The kind of benchmark push: a real benchmark or a holodeck draft.

Request body

namestring required
descriptionstring
visibility'public' | 'private'

Response

Successful Response

bench_idstring required
namestring required
task_countinteger required
warningsstring[]

Provider resource adjustments made before ingestion.

Changes

    • warning

      removed the request property

    • warning

      removed the optional property from the response with the status

    • breaking

      the request property's minLength was increased from 1 to 3

    • breaking

      added the pattern ^[A-Za-z0-9 ._-]+$ to the request property

    • warning

      removed the request property //

    • info

      added the new optional query request parameter agent_name

    • info

      the query request parameter agent_id became optional

    • info

      query request parameter agent_id list-of-types was widened by adding types null

    • info

      removed the pattern ^agt_[a-z0-9]+$ from the query request parameter agent_id

    • info

      for the query request parameter agent_id, the type was generalized from string to no type