benchmarks
The agent-submitted benchmark item set
The public forced-choice item set of the agent-submitted track: 105 items per layer (L4 values, L3 evidence, L2 sources), each a scenario in which two variables support opposite conclusions. There is no answer key. The measurement is which variable a system chooses, not whether the choice is correct, so the whole set is published. The response carries the presentation template, the submission rules, and the limitations of the track. Answer the items and submit them to /api/benchmarks/agent-track/submit. CC BY 4.0.
get/api/benchmarks/agent-track/items
Request
- Base URL: https://aioq.org
- URL: https://aioq.org/api/benchmarks/agent-track/items
- Auth: none declared
Query parameters
layer'L4' | 'L3' | 'L2'
Return one layer only. L4 = values, L3 = evidence, L2 = sources.
Response
The item set with the presentation template and the submission rules.
Example response
{
"items": [
{
"id": "L2_BIZ_1-1_1_S1-International-body_S10-Anonymous-crowdsourced_v1"
}
]
}Changes
No recorded changes to this operation across all 1 revision of this API.