---
title: "Get Per Annotator Agreement"
method: GET
path: "/api/v1/analytics/rankings/{ranking_id}/per-annotator-agreement"
tags: ["Analytics"]
---

# Get Per Annotator Agreement

`GET /api/v1/analytics/rankings/{ranking_id}/per-annotator-agreement`

## Request

- Base URL: `https://app.aimrank.io` (the document declares no server; this is the origin it was published from)
- URL: `https://app.aimrank.io/api/v1/analytics/rankings/{ranking_id}/per-annotator-agreement`
- Auth: none declared

Per-annotator κ vs the majority-vote consensus.

Surfaces noisy / low-quality annotators so the ranking owner can drop
them from RLHF exports. Owner-only — exposes per-voter quality which
is sensitive. Returns annotators sorted worst-first (lowest κ).

`min_pairs` excludes annotators with too few overlapping pairs to
estimate κ stably (default 3).

## Path parameters

- `ranking_id` string, required

## Query parameters

- `min_pairs` integer
- `limit` integer

## Response `200`

Successful Response

- unknown

## Other responses

- `422`: Validation Error

---

[API](https://skmtc.dev/aimrank/apis/aimrank-api.md) · [All operations](https://skmtc.dev/aimrank/apis/aimrank-api/llms.txt) · [OpenAPI document](https://skmtc.dev/aimrank/apis/aimrank-api/revisions/3574d0aff459?raw)