---
title: "Run a pack's eval fixtures against the live extractor"
method: POST
path: "/v1/admin/packs/{packId}/eval"
tags: ["Domain Packs"]
---

# Run a pack's eval fixtures against the live extractor

`POST /v1/admin/packs/{packId}/eval`

## Request

- Base URL: `https://brain.inite.ai`
- URL: `https://brain.inite.ai/v1/admin/packs/{packId}/eval`
- Auth: HTTP bearer

Scores whether extraction (with the pack's predicates + extractionProfile active) still meets the pack’s own expectations. Runs up to MAX_EVAL_FIXTURES live LLM calls — throttled to 3 requests/min per credential.

Required scope: `brain:admin`.

## Path parameters

- `packId` string, required

## Query parameters

- `mode` 'union' | 'dedicated'

## Response `201`

The eval report.

- PackEvalReport
  - `packId` string, required
  - `passed` integer, required
  - `results` PackEvalFixtureResult[], required
    - `failures` string[], required: Human-readable reasons the fixture failed (empty when passed).
    - `id` string, required
    - `passed` boolean, required
  - `total` integer, required
  - `version` string, required

## Other responses

- `400`: Validation failed.
- `401`: Missing or unknown bearer key.
- `403`: The key lacks the required scope.
- `404`: No such resource in this tenant.
- `429`: Per-credential throttle exceeded.

---

[API](https://skmtc.dev/inite/apis/inite-brain-platform-api.md) · [All operations](https://skmtc.dev/inite/apis/inite-brain-platform-api/llms.txt) · [OpenAPI document](https://skmtc.dev/inite/apis/inite-brain-platform-api/revisions/c7c3eb5e304b?raw)