---
title: "Create Benchmark"
method: POST
path: "/api/v0/agent/evals/benchmarks"
tags: ["Agent Evals"]
---

# Create Benchmark

`POST /api/v0/agent/evals/benchmarks`

## Request

- Base URL: `https://api.outerport.com` (the document declares no server; this is the origin it was published from)
- URL: `https://api.outerport.com/api/v0/agent/evals/benchmarks`
- Auth: HTTP bearer

Create an empty benchmark.

## Request body

- BenchmarkCreateRequest
  - `name` string, required: The benchmark's name.
  - `persona_id` string, uuid, nullable: The persona runs use unless they name another. Null for the default persona.
  - `rubric` string: Instructions the judge grades every case by.

## Response `200`

Successful Response

- AgentEvalBenchmarkResponse: A benchmark with its cases.
  - `id` string, uuid, required: The ID of the benchmark.
  - `name` string, required: The benchmark's name.
  - `persona_id` string, uuid, nullable: The persona a run uses unless it names another. Null for the default.
  - `rubric` string, required: Instructions the judge grades every case by.
  - `cases` AgentEvalCaseResponse[], required: The benchmark's cases, in order.
    - `id` string, uuid, required: The ID of the case.
    - `position` integer, required: The case's place in the benchmark, from 1.
    - `input` string, required: The prompt the agent is given.
    - `expected_output` string, required: The answer the judge compares against.
    - `documents` AgentEvalDocumentRef[]: Documents the agent is given alongside the input.
      - `id` string, uuid, required: The ID of the document.
      - `name` string, required: The document's name.
  - `created_at` string, date-time, required: When the benchmark was created.
  - `updated_at` string, date-time, required: When the benchmark or its cases last changed.

## Other responses

- `422`: Validation Error

## Changes

- **2026-10-22** `fd2664afd5a3`: 1 info
  - endpoint added

[Operation history](https://skmtc.dev/outerport/apis/outerport-api/changes/api/v0/agent/evals/benchmarks/post.md)

---

[API](https://skmtc.dev/outerport/apis/outerport-api.md) - [All operations](https://skmtc.dev/outerport/apis/outerport-api/llms.txt) - [OpenAPI document](https://skmtc.dev/outerport/apis/outerport-api/revisions/08b5bf6f7f18?raw)