--- title: "Changes to Start Eval Route" method: POST path: "/api/v1/eval" --- # Changes to Start Eval Route `POST /api/v1/eval` > Every recorded change to this operation, newest first. ## Timeline Changed in 18 of 63 revisions. - **2026-11-02** `5b5a8ae4b4a4`: 5 info - **2026-11-02** `ac63eff4913f`: 1 breaking, 21 warning, 23 info - **2026-10-31** `7b218d495d5c`: 1 breaking, 1 info - **2026-10-23** `0a17f8723be0`: 4 info - **2026-10-23** `a99a7b2a5444`: 8 info - **2026-10-21** `cac0bc23e466`: 2 info - **2026-10-20** `d2a2f0337945`: 2 breaking, 1 warning, 2 info - **2026-10-19** `1b4f7d95e884`: 1 breaking, 2 warning, 2 info - **2026-10-18** `db33cd63ac53`: 1 info - **2026-10-17** `30d547077e65`: 4 info - **2026-10-15** `7f7a777f5bb4`: 3 warning, 3 info - **2026-10-15** `b6eb5ddf06a9`: 22 breaking, 3 info - **2026-10-14** `a9423fc3918b`: 1 breaking - **2026-10-13** `cdeafc877c06`: 3 info - **2026-10-09** `d7af7940d2fc`: 1 warning - **2026-10-07** `db059a2d3fb0`: 3 info - **2026-10-06** `358e551babca`: 5 info - **2026-10-02** `a0e690b1ef27`: 1 info ## Changes - **2026-11-02** `5b5a8ae4b4a4`: 5 info - added the new optional request property `options/anyOf[subschema #1: RunOptions]/val_max_output_tokens_per_trajectory` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/val_max_output_tokens_per_turn` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/val_max_turns_per_trajectory` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/val_trajectory_timeout_seconds` - the `options/anyOf[subschema #1: RunOptions]/max_concurrent_trajectories/anyOf[subschema #1]/` request property's max was increased from `512.00` to `1024.00` - **2026-11-02** `ac63eff4913f`: 1 breaking, 21 warning, 23 info - removed the enum value `reinforce_plus_plus` of the request property `options/anyOf[subschema #1: RunOptions]/algorithm/anyOf[subschema #1: TrainingAlgorithm]/` - removed the request property `options/anyOf[subschema #1: RunOptions]/batch_collection_idle_timeout_seconds` - removed the request property `options/anyOf[subschema #1: RunOptions]/evaluation_collection_timeout_seconds` - removed the request property `options/anyOf[subschema #1: RunOptions]/evaluation_enabled` - removed the request property `options/anyOf[subschema #1: RunOptions]/evaluation_frequency` - removed the request property `options/anyOf[subschema #1: RunOptions]/evaluation_max_active_rollouts` - removed the request property `options/anyOf[subschema #1: RunOptions]/evaluation_max_samples` - removed the request property `options/anyOf[subschema #1: RunOptions]/evaluation_reasoning_effort` - removed the request property `options/anyOf[subschema #1: RunOptions]/evaluation_samples_per_task` - removed the request property `options/anyOf[subschema #1: RunOptions]/evaluation_temperature` - removed the request property `options/anyOf[subschema #1: RunOptions]/evaluation_top_k` - removed the request property `options/anyOf[subschema #1: RunOptions]/evaluation_top_p` - removed the request property `options/anyOf[subschema #1: RunOptions]/execution_timeout_seconds` - removed the request property `options/anyOf[subschema #1: RunOptions]/intelligent_density_training` - removed the request property `options/anyOf[subschema #1: RunOptions]/max_active_rollouts` - removed the request property `options/anyOf[subschema #1: RunOptions]/max_output_tokens_per_step` - removed the request property `options/anyOf[subschema #1: RunOptions]/max_steps_off_policy` - removed the request property `options/anyOf[subschema #1: RunOptions]/max_total_tokens_per_trajectory` - removed the request property `options/anyOf[subschema #1: RunOptions]/min_lr_ratio` - removed the request property `options/anyOf[subschema #1: RunOptions]/min_samples_per_group` - removed the request property `options/anyOf[subschema #1: RunOptions]/samples_per_instance` - removed the request property `options/anyOf[subschema #1: RunOptions]/train_batch_size` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/batch_size` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/batch_timeout_seconds` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/density_aware_training` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/lr_min_ratio` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/max_concurrent_trajectories` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/max_output_tokens_per_trajectory` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/max_output_tokens_per_turn` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/max_staleness` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/min_trajectories_per_group` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/train_on_all_fail` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/train_on_all_pass` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/train_on_zero_advantage` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/trajectory_timeout_seconds` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/val_enabled` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/val_final_wait_timeout_seconds` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/val_interval_steps` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/val_max_concurrent_trajectories` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/val_num_tasks` - …5 more - **2026-10-31** `7b218d495d5c`: 1 breaking, 1 info - removed the enum value `qwen/qwen3-235b-a22b` of the request property `base_model_slug/anyOf[subschema #1: BaseModelSlug]/` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/load_weights_only` - **2026-10-23** `0a17f8723be0`: 4 info - added the new optional request property `options/anyOf[subschema #1: RunOptions]/group_size` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/min_samples_per_group` - request property `options/anyOf[subschema #1: RunOptions]/samples_per_instance` deprecated - the `options/anyOf[subschema #1: RunOptions]/max_total_tokens_per_trajectory/anyOf[subschema #1]/` request property's min was decreased from `1024.00` to `1.00` - **2026-10-23** `a99a7b2a5444`: 8 info - added the new optional request property `options/anyOf[subschema #1: RunOptions]/evaluation_reasoning_effort` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/evaluation_temperature` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/evaluation_top_k` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/evaluation_top_p` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/temperature` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/top_k` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/top_p` - the `options/anyOf[subschema #1: RunOptions]/max_total_tokens_per_trajectory/anyOf[subschema #1]/` request property's max was increased from `262144.00` to `2097152.00` - **2026-10-21** `cac0bc23e466`: 2 info - added the new optional request property `options/anyOf[subschema #1: RunOptions]/evaluation_frequency` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/max_steps_off_policy` - **2026-10-20** `d2a2f0337945`: 2 breaking, 1 warning, 2 info - `header` request parameter `Idempotency-Key` list-of-types was narrowed by removing types `null` - for the `header` request parameter `Idempotency-Key`, the minLength was increased from `0` to `1` - for the `header` request parameter `Idempotency-Key`, the maxLength was set to `256` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/evaluation_enabled` - for the `header` request parameter `Idempotency-Key`, the type was generalized from no type to `string` - **2026-10-19** `1b4f7d95e884`: 1 breaking, 2 warning, 2 info - removed the enum value `none` of the request property `options/anyOf[subschema #1: RunOptions]/reasoning_effort/anyOf[subschema #1]/` - removed the request property `options/anyOf[subschema #1: RunOptions]/disable_thinking` - removed the request property `options/anyOf[subschema #1: RunOptions]/n_parallel_agents` - added the new `off` enum value to the request property `options/anyOf[subschema #1: RunOptions]/reasoning_effort/anyOf[subschema #1]/` - added the new `on` enum value to the request property `options/anyOf[subschema #1: RunOptions]/reasoning_effort/anyOf[subschema #1]/` - **2026-10-18** `db33cd63ac53`: 1 info - added the new optional request property `options/anyOf[subschema #1: RunOptions]/max_active_rollouts` - **2026-10-17** `30d547077e65`: 4 info - added the new optional request property `options/anyOf[subschema #1: RunOptions]/reasoning_effort` - added the new `openai/gpt-6-astra` enum value to the request property `base_model_slug/anyOf[subschema #1: BaseModelSlug]/` - added the new `openai/gpt-6-sol` enum value to the request property `base_model_slug/anyOf[subschema #1: BaseModelSlug]/` - added the new `openai/gpt-6.1-sol` enum value to the request property `base_model_slug/anyOf[subschema #1: BaseModelSlug]/` - **2026-10-15** `7f7a777f5bb4`: 3 warning, 3 info - removed the request property `options/anyOf[subschema #1: RunOptions]/max_response_chars_per_tool_call` - removed the request property `options/anyOf[subschema #1: RunOptions]/max_tool_calls_per_step` - removed the request property `options/anyOf[subschema #1: RunOptions]/train_on_ungraded` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/train_on_error` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/train_on_timeout` - added the new `z-ai/glm-5.3-flash` enum value to the request property `base_model_slug/anyOf[subschema #1: BaseModelSlug]/` - **2026-10-15** `b6eb5ddf06a9`: 22 breaking, 3 info - removed the enum value `Qwen/Qwen3.5-397B-A17B` of the request property `base_model_slug` - removed the enum value `Qwen/Qwen3.5-4B` of the request property `base_model_slug` - removed the enum value `Qwen/Qwen3.6-35B-A3B` of the request property `base_model_slug` - removed the enum value `Qwen/Qwen3.8-27B` of the request property `base_model_slug` - removed the enum value `anthropic/claude-opus-5.5` of the request property `base_model_slug` - removed the enum value `anthropic/claude-sonnet-4.6` of the request property `base_model_slug` - removed the enum value `anthropic/claude-sonnet-5.5` of the request property `base_model_slug` - removed the enum value `google/gemini-3.1-pro-preview` of the request property `base_model_slug` - removed the enum value `moonshotai/kimi-k3` of the request property `base_model_slug` - removed the enum value `nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16` of the request property `base_model_slug` - removed the enum value `nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16` of the request property `base_model_slug` - removed the enum value `nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16` of the request property `base_model_slug` - removed the enum value `nvidia/NVIDIA-Nemotron-3.5-Super-120B-A12B-BF16` of the request property `base_model_slug` - removed the enum value `openai/gpt-5-mini` of the request property `base_model_slug` - removed the enum value `openai/gpt-5.4-mini` of the request property `base_model_slug` - removed the enum value `openai/gpt-5.5` of the request property `base_model_slug` - removed the enum value `openai/gpt-5.6-luna` of the request property `base_model_slug` - removed the enum value `openai/gpt-5.6-sol` of the request property `base_model_slug` - removed the enum value `qwen/qwen3-235b-a22b` of the request property `base_model_slug` - removed the enum value `thinkingmachines/Inkling-Small` of the request property `base_model_slug` - removed the enum value `z-ai/glm-5.3` of the request property `base_model_slug` - the `base_model_slug` request property type changed from `string` to no type - added the new optional request property `deployment_id` - added `#/components/schemas/BaseModelSlug, subschema #2` to the `base_model_slug` request property `anyOf` list - the request property `base_model_slug` became optional - **2026-10-14** `a9423fc3918b`: 1 breaking - removed the enum value `Qwen/Qwen3.6-27B` of the request property `base_model_slug` - **2026-10-13** `cdeafc877c06`: 3 info - the `options/anyOf[subschema #1: RunOptions]/lr_hold_steps/anyOf[subschema #1]/` request property's max was increased from `400.00` to `100000.00` - the `options/anyOf[subschema #1: RunOptions]/lr_warmup_steps/anyOf[subschema #1]/` request property's max was increased from `400.00` to `100000.00` - the `options/anyOf[subschema #1: RunOptions]/num_steps/anyOf[subschema #1]/` request property's max was increased from `400.00` to `100000.00` - **2026-10-09** `d7af7940d2fc`: 1 warning - removed the request property `options/anyOf[subschema #1: RunOptions]/retries` - **2026-10-07** `db059a2d3fb0`: 3 info - added the new optional request property `options/anyOf[subschema #1: RunOptions]/retries` - added the new optional request property `task_split` - added the optional property `task_selection` to the response with the `202` status - **2026-10-06** `358e551babca`: 5 info - added the new optional request property `agent_name` - added the new optional request property `benchmark_name` - added the new optional request property `options/anyOf[subschema #1: RunOptions]/intelligent_density_training` - the request property `bench_id` became optional - request property `bench_id` list-of-types was widened by adding types `null` to media type `application/json` - **2026-10-02** `a0e690b1ef27`: 1 info - endpoint added --- [Operation](https://skmtc.dev/trajectory/apis/trajectory-api/docs/api/v1/eval/post.md) - [API](https://skmtc.dev/trajectory/apis/trajectory-api.md) - [Page](https://skmtc.dev/trajectory/apis/trajectory-api/changes/api/v1/eval/post)