Sign in
Benchmarks

List Benchmarks

Unified benchmark endpoint that aggregates scores from multiple benchmark sources (Artificial Analysis, Design Arena, and OpenRouter's own tau-bench, GPQA, and web-search evals). Filter by source to reproduce the exact shapes from the legacy per-source endpoints, or use task_type to find models suited for specific workloads. Use task_type=search (or a search_* benchmark_type) for OpenRouter's search benchmarks, which publish each model's highest-scoring eligible evaluation configuration with same-configuration runs combined by task-weighted mean. Authenticate with any valid OpenRouter API key. Rate-limited to 30 requests/minute per key and 500 requests/day per account.

get/benchmarks

Query parameters

source'artificial-analysis' | 'design-arena' | 'openrouter'

Benchmark source to query. Determines the shape of the returned items. When omitted, returns results from all sources.

Example:artificial-analysis

Benchmark source to query. Determines the shape of the returned items. When omitted, returns results from all sources.

task_type'coding' | 'intelligence' | 'agentic' | 'search'

Filter results by task type. For Artificial Analysis, maps to the corresponding index. For Design Arena, maps to the matching category. search returns OpenRouter search benchmark results only.

Example:coding

Filter results by task type. For Artificial Analysis, maps to the corresponding index. For Design Arena, maps to the matching category. search returns OpenRouter search benchmark results only.

benchmark_type'gpqa_diamond' | 'tau_bench_verified_airline' | 'search_browsecomp' | 'search_hle' | 'search_dsqa' | 'search_widesearch'

Return results for one exact OpenRouter benchmark. A search_* value narrows the response to search results only; a classic value narrows the OpenRouter items and leaves other sources' items as they are.

Example:search_widesearch

Return results for one exact OpenRouter benchmark. A search_* value narrows the response to search results only; a classic value narrows the OpenRouter items and leaves other sources' items as they are.

include_run_configboolean

Search benchmarks only: include the published lane configuration whitelist in each search item. Defaults to false. The whitelist is limited to agent turn count, reasoning effort, and temperature so future harness configuration changes do not change the public contract.

Example:true

Search benchmarks only: include the published lane configuration whitelist in each search item. Defaults to false. The whitelist is limited to agent turn count, reasoning effort, and temperature so future harness configuration changes do not change the public contract.

search_enginestring

OpenRouter search benchmarks only: filter by the search engine used.

Example:exa

OpenRouter search benchmarks only: filter by the search engine used.

search_surface'server-tool' | 'plugin'

OpenRouter search benchmarks only: filter by the request surface the lane ran on.

Example:server-tool

OpenRouter search benchmarks only: filter by the request surface the lane ran on.

arena'models' | 'builders' | 'agents'

Design Arena only: arena to query. Defaults to models when source is design-arena.

Example:models

Design Arena only: arena to query. Defaults to models when source is design-arena.

categorystring

Design Arena only: category within the arena (e.g. codecategories, uicomponent, gamedev, 3d, dataviz, image, video, svg). When omitted, returns all categories.

Example:codecategories

Design Arena only: category within the arena (e.g. codecategories, uicomponent, gamedev, 3d, dataviz, image, video, svg). When omitted, returns all categories.

max_resultsinteger

Maximum number of items to return. When omitted, all matching results are returned.

Example:50

Maximum number of items to return. When omitted, all matching results are returned.

Response

Benchmark results filtered by the specified source and optional task type.

Example response

{
  "data": [
    {
      "agentic_index": 58.3,
      "coding_index": 65.8,
      "display_name": "GPT-4o",
      "intelligence_index": 71.2,
      "model_permaslug": "openai/gpt-4o",
      "pricing": {
        "completion": "0.00001",
        "prompt": "0.0000025"
      },
      "source": "artificial-analysis"
    },
    {
      "accuracy": 0.72,
      "accuracy_stddev": 0.03,
      "avg_cost_per_task": 0.002,
      "benchmark_type": "gpqa_diamond",
      "display_name": "GPT-4o",
      "last_run_timestamp": "2026-06-03T12:00:00Z",
      "model_permaslug": "openai/gpt-4o",
      "source": "openrouter",
      "total_tasks": 300
    }
  ],
  "meta": {
    "as_of": "2026-06-03T12:00:00Z",
    "citation": null,
    "model_count": 1,
    "source": null,
    "source_url": null,
    "task_type": null,
    "version": "v1"
  }
}

Changes

Changed in 4 of the 303 revisions of this API.6210

  • b0e4c71ef36a16See the full diff
    • ▲

      added to the / response property oneOf list for the response status

      response-property-one-of-added

    • ○

      added the new optional query request parameter benchmark_type

      new-optional-request-parameter

    • ○

      added the new optional query request parameter include_run_config

      new-optional-request-parameter

    • ○

      added the new optional query request parameter search_engine

      new-optional-request-parameter

    • ○

      added the new optional query request parameter search_surface

      new-optional-request-parameter

    • ○

      added the new enum value search to the query request parameter task_type

      request-parameter-enum-value-added

    • ○

      removed discriminator from / response property for the response status

      response-property-discriminator-removed

  • 87b8071f9c16112See the full diff
    • ▲

      added to the / response property oneOf list for the response status

      response-property-one-of-added

    • ●

      added the new openrouter enum value to the / response property for the response status

      response-property-enum-value-added

    • ○

      added the new enum value openrouter to the query request parameter source

      request-parameter-enum-value-added

    • ○

      added openrouter discriminator mapping keys to the / response property for the response status

      response-property-discriminator-mapping-added

  • 4d013334dff1411See the full diff
    • ▲

      for the query request parameter max_results, default value 50 was removed

      request-parameter-default-value-removed

    • ▲

      the response property / became nullable for the status

      response-property-became-nullable

    • ▲

      the response property / became nullable for the status

      response-property-became-nullable

    • ▲

      the response property / became nullable for the status

      response-property-became-nullable

    • ●

      added the new undefined enum value to the / response property for the response status

      response-property-enum-value-added

    • ○

      the query request parameter source became optional

      request-parameter-became-optional

  • 0ff5435aba371See the full diff
    • ○

      endpoint added

      endpoint-added

    This revision also has 7 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog