The agentic web map (?month=YYYY-MM; default this month, month to date until sealed): every reachable site of a census frame (top 10,000, else top 1,000) placed in four layers - DNS host (NS records), network (A record, origin autonomous system holder), bot protection and site platform (technology record) - with what the census saw it do to AI crawlers: refused an AI identity at the edge while serving the browser, blocked one in robots.txt, served llms.txt, declared Content-Signal. Per provider (named at 10+ sites), links between layers split by those outcomes, and where refusals and blocks concentrate. ?domain= returns one domain's four layers instead (signed crawlcheck-agentic-web-map-lookup; live read if the domain is not in the map, 60 an hour per address). No site named in the edition. Signed crawlcheck-agentic-web-map; sealed editions at /api/v1/agentic-web-map/YYYY-MM.json.

get/api/v1/agentic-web-map

Request

  • Base URL: https://crawlcheck.io
  • URL: https://crawlcheck.io/api/v1/agentic-web-map
  • Auth: none required

Query parameters

monthstring
domainstring

Response

crawlcheck-agentic-web-map or crawlcheck-agentic-web-map-lookup

kindstring nullable
vnumber nullable
monthstring nullable
statestring nullable
framestring nullable
runnumber nullable
sitesnumber nullable
mappednumber nullable
sha256unknown

Changes

No recorded changes to this operation across all 1 revision of this API.