The agentic web map (?month=YYYY-MM; default this month, month to date until sealed): every reachable site of a census frame (top 10,000, else top 1,000) placed in four layers - DNS host (NS records), network (A record, origin autonomous system holder), bot protection and site platform (technology record) - with what the census saw it do to AI crawlers: refused an AI identity at the edge while serving the browser, blocked one in robots.txt, served llms.txt, declared Content-Signal. Per provider (named at 10+ sites), links between layers split by those outcomes, and where refusals and blocks concentrate. ?domain= returns one domain's four layers instead (signed crawlcheck-agentic-web-map-lookup; live read if the domain is not in the map, 60 an hour per address). No site named in the edition. Signed crawlcheck-agentic-web-map; sealed editions at /api/v1/agentic-web-map/YYYY-MM.json.
get/api/v1/agentic-web-map
Request
- Base URL: https://crawlcheck.io
- URL: https://crawlcheck.io/api/v1/agentic-web-map
- Auth: none required
Query parameters
monthstring
domainstring
Response
crawlcheck-agentic-web-map or crawlcheck-agentic-web-map-lookup
Changes
No recorded changes to this operation across all 1 revision of this API.