---
title: "List Eval Samples"
method: GET
path: "/api/v1/console/evals/samples"
tags: ["evals"]
---

# List Eval Samples

`GET /api/v1/console/evals/samples`

## Request

- Base URL: `https://ndi-api.nace.ai` (the document declares no server; this is the origin it was published from)
- URL: `https://ndi-api.nace.ai/api/v1/console/evals/samples`
- Auth: HTTP bearer
- TypeScript: <https://skmtc.dev/nace/apis/ndi-service/docs/api/v1/console/evals/samples/get.ts> (a function with typed inputs; its response is checked against the schema)

The packaged eval samples a run can select from.

Each entry says whether it can actually run here: a sample that attaches a
prepared corpus workspace nobody has provisioned is listed as blocked rather
than offered and then failed.

## Headers

- `x-api-key` string, nullable

## Response `200`

Successful Response

- EvalSampleListResponse
  - `samples` EvalSampleSummary[], required
    - `id` string, required
    - `layer` string, required: Target layer: `parse`, `ground`, `fact_search`, `query_tables`, …
    - `implementation` string, nullable
    - `tags` string[]
    - `description` string, nullable
    - `dataset` string, nullable: Labelled corpus this sample scores against, when it names one.
    - `backend` string, required: Workspace the sample needs: `local` fixtures, or an NDI platform workspace.
    - `k_runs` integer, required
    - `timeout_seconds` number, required
    - `prepared_workspace` string, nullable: Portable name (`ndi://techqa`) this sample attaches to; null when it seeds its own workspace.
    - `runnable` boolean, required: False when the sample needs a prepared workspace that has not been provisioned on this deployment.
    - `blocked_reason` string, nullable: Why `runnable` is false.
  - `layers` string[], required: Every layer present in the catalog, for the picker's filter.
  - `tags` string[], required: Every tag present in the catalog, for the picker's filter.

## Other responses

- `400`: Bad Request
- `401`: Missing or invalid bearer token.
- `402`: Payment Required
- `403`: An API key was sent, the account is not Nace staff, or it is disabled.
- `404`: No console account for this identity — sign in first.
- `409`: Conflict
- `413`: Request Entity Too Large
- `422`: Unprocessable Entity
- `500`: Internal Server Error
- `503`: The eval harness or its worker queue is not available on this deployment.

---

[API](https://skmtc.dev/nace/apis/ndi-service.md) - [All operations](https://skmtc.dev/nace/apis/ndi-service/llms.txt) - [OpenAPI document](https://skmtc.dev/nace/apis/ndi-service/revisions/d9d1f8ec2207?raw)