---
title: "POST /projects/{projectId}/eval-plan"
method: POST
path: "/projects/{projectId}/eval-plan"
---

# POST /projects/{projectId}/eval-plan

`POST /projects/{projectId}/eval-plan`

## Request

- Base URL: `https://api.caveman.so/api/v1`
- URL: `https://api.caveman.so/api/v1/projects/{projectId}/eval-plan`
- Auth: one of:
  - OAuth 2
    - Authorization code: `/api/v1/oauth/authorize`
    - Token URL: `/api/v1/oauth/token` scopes: `trace:read_metadata`
  - HTTP bearer
  - API key in cookie `cave_access`
  - API key in cookie `__Secure-cave_identity.session_token`

POST /api/v1/projects/{projectId}/eval-plan on the Caveman Cloud control plane. Requires the trace:read_metadata scope. Exposed to autonomous agents as the plan action of the caveman_quality tool (read access). Quality per workload: pass rates, issues, criteria and how far their judges are trusted, the setup Caveman proposes, judges and their calibration, CI suites, and verdicts with the cases that changed. Plan prices a comparison before anything runs. A criterion's trend reads its failure rate over time and across models from sampled live traffic; its comparisons are observed, not verified. The Review queue lists the units waiting for a person's label.

## Request body

- object
  - `workload_id` string, uuid, required
  - `run` object
    - `source` 'eval_run' | 'experiment' | 'scenario_run' | 'factory_comparison', required
    - `run_id` string, uuid, required
  - `metric` 'preference' | 'pass_rate'
  - `margin` number
  - `claim` 'cost_and_quality' | 'quality_only'
  - `criteria` string[]
  - `cases_available` integer
  - `trials` integer
  - `power` number

## Response `2XX`

Successful response. Exact status depends on synchronous or durable delivery outcome.

## Other responses

- `4XX`: Structured failure. `error.code` is stable; `error.request_id` is echoed in the x-cave-request-id header.
- `5XX`: Structured failure. `error.code` is stable; `error.request_id` is echoed in the x-cave-request-id header.

---

[API](https://skmtc.dev/caveman/apis/caveman-cloud-api.md) - [All operations](https://skmtc.dev/caveman/apis/caveman-cloud-api/llms.txt) - [OpenAPI document](https://skmtc.dev/caveman/apis/caveman-cloud-api/revisions/508312d01cfc?raw)