TRtrajectory
eval

Start Eval Route

Changed on

Evaluate the test split by default. Set task_split to all to evaluate test and train tasks.

post/api/v1/eval

Request

  • Base URL
    https://api.trajectory.ai (the document declares no server; this is the origin it was published from)
  • URL
    https://api.trajectory.ai/api/v1/eval
  • Auth
    none declared

Headers

Idempotency-Keystring

Optional. Without a key, repeated submissions are treated as separate actions. A blank or over-long key is rejected. Reuse this key when retrying a submission; the SDK generates one per call and reuses it across automatic retries.

Request body

bench_idstring nullable

Benchmark ID; use instead of agent_name and benchmark_name.

agent_namestring nullable

Use with benchmark_name to select its latest benchmark version.

benchmark_namestring nullable

Use with agent_name to select the latest benchmark version.

bypass_ownershipboolean

Allow a supplied agent to differ from the benchmark owner within the same organization; run attribution uses the benchmark owner.

agent_idstring nullable

Optional agent for ownership checks; not a benchmark selector.

base_model_slug'thinkingmachines/Inkling-Small' | 'Qwen/Qwen3.5-4B' | 'Qwen/Qwen3.5-397B-A17B' | 'Qwen/Qwen3.6-35B-A3B' | 'Qwen/Qwen3.8-27B' | 'nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16' | 'nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16' | 'nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16' | 'nvidia/NVIDIA-Nemotron-3.5-Super-120B-A12B-BF16' | 'openai/gpt-6.1-sol' | 'openai/gpt-6-sol' | 'openai/gpt-6-astra' | 'openai/gpt-5.6-sol' | 'openai/gpt-5.6-luna' | 'anthropic/claude-opus-5.5' | 'anthropic/claude-sonnet-5.5' | 'openai/gpt-5-mini' | 'openai/gpt-5.4-mini' | 'openai/gpt-5.5' | 'anthropic/claude-sonnet-4.6' | 'google/gemini-3.1-pro-preview' | 'z-ai/glm-5.3' | 'z-ai/glm-5.3-flash' | 'moonshotai/kimi-k3'
parent_checkpoint_idstring nullable

Checkpoint to resume training from or evaluate; must match the selected base model. Checkpoint evaluations inherit supported token and turn limits from the source training run unless the evaluation overrides them.

display_namestring nullable
deployment_idstring nullable

Evaluate the exact hosted checkpoint and pool of a ready deployment.

task_split'test' | 'all'

Response

Successful Response

bench_idstring required

Benchmark evaluated by this run.

eval_run_idstring required

Evaluation run created for this request.

display_namestring nullable required

User-facing name for the evaluation run.

Changes

  • 5b5a8ae4b4a4Revision changes
    • info

      added the new optional request property //

    • info

      added the new optional request property //

    • info

      added the new optional request property //

    • info

      added the new optional request property //

    • info

      the /// request property's max was increased from 512.00 to 1024.00

  • ac63eff4913fRevision changes
    • breaking

      removed the enum value reinforce_plus_plus of the request property ///

    • warning

      removed the request property //

    • warning

      removed the request property //

    • warning

      removed the request property //

    • warning

      removed the request property //

    • warning

      removed the request property //

    • warning

      removed the request property //

    • warning

      removed the request property //

    • warning

      removed the request property //

    • warning

      removed the request property //

    • warning

      removed the request property //

    • warning

      removed the request property //

    • warning

      removed the request property //

    • warning

      removed the request property //

    • warning

      removed the request property //

    • warning

      removed the request property //

    • warning

      removed the request property //

    • warning

      removed the request property //

    • warning

      removed the request property //

    • warning

      removed the request property //

    • warning

      removed the request property //

    • warning

      removed the request property //

    • info

      added the new optional request property //

    • info

      added the new optional request property //

    • info

      added the new optional request property //

    • info

      added the new optional request property //

    • info

      added the new optional request property //

    • info

      added the new optional request property //

    • info

      added the new optional request property //

    • info

      added the new optional request property //

    • info

      added the new optional request property //

    • info

      added the new optional request property //

    • info

      added the new optional request property //

    • info

      added the new optional request property //

    • info

      added the new optional request property //

    • info

      added the new optional request property //

    • info

      added the new optional request property //

    • info

      added the new optional request property //

    • info

      added the new optional request property //

    • info

      added the new optional request property //

    • info

      added the new optional request property //

    • info

      added the new optional request property //

    • info

      added the new optional request property //

    • info

      added the new optional request property //

    • info

      added the new optional request property //