MEmercury-hq
cited-sitemap
sitemap
sitemap-xml
crawl-frontier
url-inventory
seo
indexability
site-coverage
verifiable-data-record
attestation
provenance
keyless
agent-native
scraping
rag

MERCURY Cited Sitemap

Domain/URL → a SIGNED snapshot of the site's PUBLISHED sitemap: discovers the sitemap via robots.txt Sitemap: lines then /sitemap.xml fallback, parses <urlset> + <sitemapindex> (follows up to 5 child sitemaps), returns a deduped, bounded (≤2000) URL inventory with lastmod/changefreq/priority. The receipt signs the DECLARED URL list (deterministic — same sitemap bytes ⇒ byte-identical list). Optional ?fetch=N (≤10) adds a HARD-BOUNDED same-domain liveness probe (title+status+bytes per URL) — that probe is the ONLY non-deterministic part and is NOT covered by the signature. SSRF-guarded; the crawl is bounded at every axis.

get/buy/sitemap

Request

Query parameters

urlstring required

a domain (example.com) or any URL on the site — only its origin is used

fetchstring

optional N (0–10): also shallow-fetch the first N same-domain sitemap URLs and report each one's live title + HTTP status + byte size (liveness sample). NOT covered by the signed receipt (it can change between calls). Default 0 = off.

limitstring

optional cap on URLs returned (1–2000); default returns all up to 2000

Response

Delivered after the x402 payment settles on Base mainnet.

okboolean required

true on success; false on an honest failure (still delivered)

urlstring required

the sitemap URL that was fetched + parsed

statusinteger

upstream HTTP status of the sitemap fetch

textstring

canonical newline string the signed receipt covers: one URL per line, origin-then-loc sorted (the DECLARED inventory only — never the live-probe sample, so it is reproducible)

contentTypestring
fetchedAtstring

ISO8601 fetch time (in the signed payload)

errorstring

present only when ok:false

Changes

No recorded changes to this operation across all 1 revision of this API.