---
title: "POST /projects/{projectId}/eval-qualification-sets"
method: POST
path: "/projects/{projectId}/eval-qualification-sets"
---

# POST /projects/{projectId}/eval-qualification-sets

`POST /projects/{projectId}/eval-qualification-sets`

## Request

- Base URL: `https://api.caveman.so/api/v1`
- URL: `https://api.caveman.so/api/v1/projects/{projectId}/eval-qualification-sets`
- Auth: one of:
  - OAuth 2
    - Authorization code: `/api/v1/oauth/authorize`
    - Token URL: `/api/v1/oauth/token` scopes: `autopilot:manage`
  - HTTP bearer
  - API key in cookie `cave_access`
  - API key in cookie `__Secure-cave_identity.session_token`

POST /api/v1/projects/{projectId}/eval-qualification-sets on the Caveman Cloud control plane. Requires the autopilot:manage scope. Not exposed to autonomous agents: Independent holdout labels must not be authored by the agent whose evaluator they qualify.

## Request body

- EvaluatorQualificationSetConfiguration
  - `name` string, required
  - `invariant` string, required
  - `grader_type` string, required
  - `subject_column` string, required
  - `label_column` string, required
  - `identity_column` string, required
  - `challenge_version_id` string, uuid, required
  - `population_version_id` string, uuid, required
  - `sampling_method` 'random' | 'systematic' | 'complete_population', required
  - `population_definition` string, required
  - `label_provenance` string, required
  - `agent_id` string, uuid, nullable
  - `workflow_id` string, uuid, nullable

## Response `201`

Immutable independent set registered. Labels and subject semantics are supplied by authorized native users, never the evaluator author.

## Other responses

- `422`: Independent sets or population metadata are incompatible.
- `4XX`: Structured failure. `error.code` is stable; `error.request_id` is echoed in the x-cave-request-id header.
- `5XX`: Structured failure. `error.code` is stable; `error.request_id` is echoed in the x-cave-request-id header.

---

[API](https://skmtc.dev/caveman/apis/caveman-cloud-api.md) - [All operations](https://skmtc.dev/caveman/apis/caveman-cloud-api/llms.txt) - [OpenAPI document](https://skmtc.dev/caveman/apis/caveman-cloud-api/revisions/508312d01cfc?raw)