---
title: "PUT /projects/{projectId}/eval-evaluators/{evaluatorId}"
method: PUT
path: "/projects/{projectId}/eval-evaluators/{evaluatorId}"
---

# PUT /projects/{projectId}/eval-evaluators/{evaluatorId}

`PUT /projects/{projectId}/eval-evaluators/{evaluatorId}`

## Request

- Base URL: `https://api.caveman.so/api/v1`
- URL: `https://api.caveman.so/api/v1/projects/{projectId}/eval-evaluators/{evaluatorId}`
- Auth: one of:
  - OAuth 2
    - Authorization code: `/api/v1/oauth/authorize`
    - Token URL: `/api/v1/oauth/token` scopes: `eval:write`
  - HTTP bearer
  - API key in cookie `cave_access`
  - API key in cookie `__Secure-cave_identity.session_token`

PUT /api/v1/projects/{projectId}/eval-evaluators/{evaluatorId} on the Caveman Cloud control plane. Requires the eval:write scope. Exposed to autonomous agents as the update_evaluator action of the caveman_evals_write tool (write access). Author versioned datasets, reusable evaluators and workbenches; create strict suites, ingest evidence, and run baselines. Evidence ingest supports dry_run — always dry-run first. Ask Caveman to draft quality criteria again within the drafting allowance, propose a criterion for a person to turn on, and hold the pull request that adds the Caveman check to CI. Track a criterion on a slice of traces in one step: from an agent it lands proposed, and a person turns it on. Queue units for review and label them (an agent's label is recorded as an agent's, never as human gold), and make a dataset from recorded traffic.

## Request body

- object
  - `revision` integer, required
  - `name` string, required
  - `description` string
  - `config` object, required: Versioned evaluator configuration. grader_type is validated against grader-registry.json by control-api.
    - `schema_version` unknown, required
    - `grader_type` string, required
    - `options` object, required
    - `input_mapping` object, required
      - `candidate` object, required
        - `source` 'dataset' | 'target', required
        - `key` union, required
          - string
          - '$target'
      - `reference` object
        - `source` 'dataset' | 'target', required
        - `key` union, required
          - string
          - '$target'
      - `baseline` object
        - `source` 'dataset' | 'target', required
        - `key` union, required
          - string
          - '$target'

## Response `2XX`

Successful response. Exact status depends on synchronous or durable delivery outcome.

## Other responses

- `4XX`: Structured failure. `error.code` is stable; `error.request_id` is echoed in the x-cave-request-id header.
- `5XX`: Structured failure. `error.code` is stable; `error.request_id` is echoed in the x-cave-request-id header.

---

[API](https://skmtc.dev/caveman/apis/caveman-cloud-api.md) - [All operations](https://skmtc.dev/caveman/apis/caveman-cloud-api/llms.txt) - [OpenAPI document](https://skmtc.dev/caveman/apis/caveman-cloud-api/revisions/508312d01cfc?raw)