---
title: "One run's per-site records in frame order: the raw readings (statuses, sizes, SHA-256 of what each identity was served, the robots.txt text, each machine file) and the derived fields every figure counts"
method: GET
path: "/api/census/records"
---

# One run's per-site records in frame order: the raw readings (statuses, sizes, SHA-256 of what each identity was served, the robots.txt text, each machine file) and the derived fields every figure counts

`GET /api/census/records`

## Request

- Base URL: `https://crawlcheck.io`
- URL: `https://crawlcheck.io/api/census/records`
- Auth: none required

## Query parameters

- `run` integer
- `offset` integer
- `limit` integer

## Response `200`

crawlcheck-census-records

- object, nullable
  - `ok` boolean, nullable
  - `kind` string, nullable
  - `run` number, nullable
  - `complete` boolean, nullable
  - `measured` number, nullable
  - `of` number, nullable
  - `offset` number, nullable
  - `returned` number, nullable
  - `next` string, nullable
  - `records` object[], nullable
    - `v` number, nullable
    - `kind` string, nullable
    - `run` number, nullable
    - `domain` string, nullable
    - `rank` number, nullable
    - `measured_at` string, nullable
    - `home` object, nullable
      - `browser` object, nullable
        - `status` number, nullable
        - `content_type` string, nullable
        - `bytes` number, nullable
        - `sha256` string, nullable
        - `final_host` string, nullable
        - `ms` number, nullable
        - `identity` string, nullable
        - `html` boolean, nullable
      - `gptbot` object, nullable
        - `status` number, nullable
        - `content_type` string, nullable
        - `bytes` number, nullable
        - `sha256` string, nullable
        - `final_host` string, nullable
        - `ms` number, nullable
        - `identity` string, nullable
        - `html` boolean, nullable
      - `claudebot` object, nullable
        - `status` number, nullable
        - `content_type` string, nullable
        - `bytes` number, nullable
        - `sha256` string, nullable
        - `final_host` string, nullable
        - `ms` number, nullable
        - `identity` string, nullable
        - `html` boolean, nullable
      - `oaisearch` object, nullable
        - `status` number, nullable
        - `content_type` string, nullable
        - `bytes` number, nullable
        - `sha256` string, nullable
        - `final_host` string, nullable
        - `ms` number, nullable
        - `identity` string, nullable
        - `html` boolean, nullable
      - `perplexity` object, nullable
        - `status` number, nullable
        - `content_type` string, nullable
        - `bytes` number, nullable
        - `sha256` string, nullable
        - `final_host` string, nullable
        - `ms` number, nullable
        - `identity` string, nullable
        - `html` boolean, nullable
    - `robots` object, nullable
      - `status` number, nullable
      - `content_type` string, nullable
      - `bytes` number, nullable
      - `sha256` string, nullable
      - `final_host` string, nullable
      - `ms` number, nullable
      - `html` boolean, nullable
      - `text` unknown
      - `agents` object, nullable
        - `GPTBot` boolean, nullable
        - `OAI-SearchBot` boolean, nullable
        - `ChatGPT-User` boolean, nullable
        - `ClaudeBot` boolean, nullable
        - `Claude-SearchBot` boolean, nullable
        - `PerplexityBot` boolean, nullable
        - `Google-Extended` boolean, nullable
        - `Applebot-Extended` boolean, nullable
        - `CCBot` boolean, nullable
        - `Bytespider` boolean, nullable
        - `Meta-ExternalAgent` boolean, nullable
        - `Amazonbot` boolean, nullable
    - `sitemap` object, nullable
      - `status` number, nullable
      - `content_type` string, nullable
      - `bytes` number, nullable
      - `sha256` string, nullable
      - `final_host` string, nullable
      - `ms` number, nullable
      - `url` string, nullable
      - `declared` boolean, nullable
      - `xml` boolean, nullable
    - `files` object, nullable
      - `llms_txt` object, nullable
        - `status` number, nullable
        - `content_type` string, nullable
        - `bytes` number, nullable
        - `sha256` string, nullable
        - `final_host` string, nullable
        - `ms` number, nullable
        - `path` string, nullable
        - `html` boolean, nullable
        - `json` unknown
        - `present` boolean, nullable
      - `agents_md` object, nullable
        - `status` number, nullable
        - `content_type` string, nullable
        - `bytes` number, nullable
        - `sha256` string, nullable
        - `final_host` string, nullable
        - `ms` number, nullable
        - `path` string, nullable
        - `html` boolean, nullable
        - `json` unknown
        - `present` boolean, nullable
      - `agent_skills` object, nullable
        - `status` number, nullable
        - `content_type` string, nullable
        - `bytes` number, nullable
        - `sha256` string, nullable
        - `final_host` string, nullable
        - `ms` number, nullable
        - `path` string, nullable
        - `html` boolean, nullable
        - `json` boolean, nullable
        - `present` boolean, nullable
      - `mcp_card` object, nullable
        - `status` number, nullable
        - `content_type` string, nullable
        - `bytes` number, nullable
        - `sha256` string, nullable
        - `final_host` string, nullable
        - `ms` number, nullable
        - `path` string, nullable
        - `html` boolean, nullable
        - `json` boolean, nullable
        - `present` boolean, nullable
      - `api_catalog` object, nullable
        - `status` number, nullable
        - `content_type` string, nullable
        - `bytes` number, nullable
        - `sha256` string, nullable
        - `final_host` string, nullable
        - `ms` number, nullable
        - `path` string, nullable
        - `html` boolean, nullable
        - `json` unknown
        - `present` boolean, nullable
      - `a2a_card` object, nullable
        - `status` number, nullable
        - `content_type` string, nullable
        - `bytes` number, nullable
        - `sha256` string, nullable
        - `final_host` string, nullable
        - `ms` number, nullable
        - `path` string, nullable
        - `html` boolean, nullable
        - `json` unknown
        - `present` boolean, nullable
    - `derived` object, nullable
      - `reachable` boolean, nullable
      - `robots_served` boolean, nullable
      - `robots_sitemap` boolean, nullable
      - `content_signal` boolean, nullable
      - `cs_ai_train_no` boolean, nullable
      - `cs_ai_input_no` boolean, nullable
      - `blocks` unknown[], nullable
        - unknown
      - `blocks_any_ai` boolean, nullable
      - `files` object, nullable
        - `llms_txt` boolean, nullable
        - `agents_md` boolean, nullable
        - `agent_skills` boolean, nullable
        - `mcp_card` boolean, nullable
        - `api_catalog` boolean, nullable
        - `a2a_card` boolean, nullable
      - `any_capability` boolean, nullable
      - `ai_refused` unknown[], nullable
        - unknown
      - `ai_thin` unknown[], nullable
        - unknown
    - `derive_v` number, nullable

---

[API](https://skmtc.dev/crawlcheck/apis/crawlcheck-api.md) · [All operations](https://skmtc.dev/crawlcheck/apis/crawlcheck-api/llms.txt) · [OpenAPI document](https://skmtc.dev/crawlcheck/apis/crawlcheck-api/revisions/57acbd6d4489?raw)