Sign in
eval

Start Eval Route

post/api/v1/eval/{bench_id}/start

Path parameters

bench_idstring required

Request body

model_slug'Qwen/Qwen3.5-4B' | 'Qwen/Qwen3.5-397B-A17B' | 'Qwen/Qwen3.6-35B-A3B' | 'nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16' | 'nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16' | 'nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16' | 'openai/gpt-5-mini' | 'openai/gpt-5.4-mini' | 'openai/gpt-5.5' | 'anthropic/claude-sonnet-4.6' | 'google/gemini-3.1-pro-preview' required
display_namestring nullable

User-facing name for the evaluation run.

checkpoint_idstring nullable

When set, evaluate this committed training checkpoint instead of the base model.

Response

Successful Response

bench_idstring required

Benchmark evaluated by this run.

eval_run_idstring required

Evaluation run created for this request.

pipeline_run_idstring required

Pipeline run executing the evaluation.

display_namestring nullable required

User-facing name for the evaluation run.

execution_idstring required

Flyte execution launched for the evaluation.

pipeline_namestring required

Pipeline configuration used by the evaluation.

experiment_namestring required

Experiment name assigned to the evaluation.

Changes

No recorded changes to this endpoint across all 1 revision of this API.