---
title: "Compare Eval"
method: GET
path: "/evals/{eval_id}/compare"
tags: ["evals"]
---

# Compare Eval

`GET /evals/{eval_id}/compare`

## Request

- Base URL: `https://api.os3robotics.com` (the document declares no server; this is the origin it was published from)
- URL: `https://api.os3robotics.com/evals/{eval_id}/compare`
- Auth: one of:
  - HTTP bearer
  - HTTP bearer

The eval's candidate against its baseline; the verdict is null, with the reason, on
fewer than `min_trials` trials or without a calibrated judge.

## Path parameters

- `eval_id` string, uuid, required

## Response `200`

Successful Response

- Comparison: GET /evals/{id}/compare: the eval's candidate against its baseline.
  - `eval_id` string, uuid, required
  - `workspace_id` string, uuid, required
  - `candidate_ref` string, required
  - `baseline_ref` string, nullable, required
  - `eval_set_ref` string, required
  - `n` integer, required
  - `wins` integer, required
  - `losses` integer, nullable, required
  - `ties` integer, nullable, required
  - `win_rate` number, required
  - `ci_lower` number, required
  - `ci_upper` number, required
  - `strength` number, nullable, required
  - `flip_rate` number, nullable, required
  - `p95_latency_ms` number, required
  - `min_trials` integer, required
  - `verdict` 'candidate_better' | 'baseline_better' | 'no_difference', nullable, required
  - `reason` string, required
  - `accuracy` object, nullable

## Other responses

- `422`: Validation Error

---

[API](https://skmtc.dev/os3robotics/apis/os3-api.md) - [All operations](https://skmtc.dev/os3robotics/apis/os3-api/llms.txt) - [OpenAPI document](https://skmtc.dev/os3robotics/apis/os3-api/revisions/af32cd4f14bb?raw)