---
title: "Compare two benchmark runs"
method: GET
path: "/v1/quality/benchmarks/compare"
tags: ["Benchmarks"]
---

# Compare two benchmark runs

`GET /v1/quality/benchmarks/compare`

## Request

- Base URL: `https://api.talonic.com`
- URL: `https://api.talonic.com/v1/quality/benchmarks/compare`
- Auth: HTTP bearer

Returns both benchmark runs side by side together with the overall accuracy delta (run_a minus run_b). The delta is null when either run has not yet produced an overall accuracy score.

## Query parameters

- `run_a` string, uuid, required
- `run_b` string, uuid, required

## Response `200`

Both benchmark runs and their accuracy delta.

- object
  - `run_a` BenchmarkResponse
    - `id` string, uuid, required
    - `name` string, nullable
    - `dataset_id` string, uuid, nullable
    - `user_schema_id` string, uuid, nullable
    - `status` string, required: Benchmark run status.
    - `accuracy_overall` number, float, nullable
    - `accuracy_by_field` object, nullable
    - `documents_processed` integer, nullable
    - `documents_total` integer, nullable
    - `duration_ms` integer, nullable
    - `accuracy_delta` number, float, nullable: Change in overall accuracy vs the compared run.
    - `compared_to_run_id` string, uuid, nullable
    - `created_at` string, date-time
    - `completed_at` string, date-time, nullable
    - `links` object
      - `self` string
      - `results` string
  - `run_b` BenchmarkResponse
    - `id` string, uuid, required
    - `name` string, nullable
    - `dataset_id` string, uuid, nullable
    - `user_schema_id` string, uuid, nullable
    - `status` string, required: Benchmark run status.
    - `accuracy_overall` number, float, nullable
    - `accuracy_by_field` object, nullable
    - `documents_processed` integer, nullable
    - `documents_total` integer, nullable
    - `duration_ms` integer, nullable
    - `accuracy_delta` number, float, nullable: Change in overall accuracy vs the compared run.
    - `compared_to_run_id` string, uuid, nullable
    - `created_at` string, date-time
    - `completed_at` string, date-time, nullable
    - `links` object
      - `self` string
      - `results` string
  - `accuracy_delta` number, float, nullable: Overall accuracy of run_a minus run_b, or null if either is unscored.

## Other responses

- `400`: The request is invalid.
- `401`: Missing or invalid API key.
- `404`: The requested resource was not found.
- `429`: Daily rate limit exceeded.

---

[API](https://skmtc.dev/talonic/apis/talonic-api.md) · [All operations](https://skmtc.dev/talonic/apis/talonic-api/llms.txt) · [OpenAPI document](https://skmtc.dev/talonic/apis/talonic-api/revisions/678fe5f8c9c3?raw)