---
title: "The agent-submitted benchmark item set"
method: GET
path: "/api/benchmarks/agent-track/items"
tags: ["benchmarks"]
---

# The agent-submitted benchmark item set

`GET /api/benchmarks/agent-track/items`

## Request

- Base URL: `https://aioq.org`
- URL: `https://aioq.org/api/benchmarks/agent-track/items`
- Auth: none declared

The public forced-choice item set of the agent-submitted track: 105 items per layer (L4 values, L3 evidence, L2 sources), each a scenario in which two variables support opposite conclusions. There is no answer key. The measurement is which variable a system chooses, not whether the choice is correct, so the whole set is published. The response carries the presentation template, the submission rules, and the limitations of the track. Answer the items and submit them to /api/benchmarks/agent-track/submit. CC BY 4.0.

## Query parameters

- `layer` 'L4' | 'L3' | 'L2'

## Response `200`

The item set with the presentation template and the submission rules.

- object
  - `track` 'agent-submitted'
  - `itemBankVersion` string
  - `count` integer
  - `totalCount` integer
  - `itemsPerLayer` object
    - `L4` integer
    - `L3` integer
    - `L2` integer
  - `presentation` object
    - `instructions` string: Prompt template with {domain}, {severity}, {timeframe}, {scenario}, {optionA}, {optionB} placeholders.
    - `responseFormat` 'choice-ab'
  - `rules` object
  - `limitations` string[]
  - `submitTo` string, uri
  - `items` object[]
    - `id` string, required
    - `layer` 'L4' | 'L3' | 'L2', required: L4 = values, L3 = evidence, L2 = sources.
    - `domain` 'MED' | 'BIZ' | 'TECH' | 'EDU' | 'LAW' | 'DEF' | 'CARE', required
    - `severity` string, required: Scale (1–5) × reversibility (1–3), e.g. "4-3".
    - `time` string, required: Time horizon of the decision, domain-relative.
    - `optionA` string, required: Variable supporting one course of action.
    - `optionB` string, required: Variable supporting the opposite course of action.
    - `scenario` string, required

## Other responses

- `400`: Unknown layer.
- `503`: The item bank is unavailable on this deployment.

---

[API](https://skmtc.dev/aioq/apis/aio-public-api.md) · [All operations](https://skmtc.dev/aioq/apis/aio-public-api/llms.txt) · [OpenAPI document](https://skmtc.dev/aioq/apis/aio-public-api/revisions/377b76120162?raw)