Data

Extract sitemap URLs (optionally change-diff)

10 credits + 1 per URL returned. With monitor=NAME returns new/updated/removed since last call. The first call for a monitor (baseline) costs a flat 10 credits for any site size (only the credits for the flat fee are reserved, so a trial can baseline a 10,000-URL sitemap) and returns counts + a 20-URL sample (monitor.urlsInSnapshot, monitor.baselinePricing="flat"); 50 flat baselines per account per day (10 on a trial), then per-URL pricing. Truncated results never save a snapshot and never report "removed".

get/v1/sitemap

Request

  • Base URL: https://crawlwisedata.com
  • URL: https://crawlwisedata.com/v1/sitemap
  • Auth: one of:
    • HTTP bearer
    • API key in header X-API-Key
    • none

Query parameters

urlstring required
maxinteger
includestring[]

Case-insensitive regex filters.

excludestring[]
lastmodAfterstring
monitorstring

Response

OK

oktrue required
endpoint'techstack' | 'feed' | 'sitemap' required
mode'paid' | 'demo' | 'marketplace' required
dataobject required

Changes

No recorded changes to this operation across all 1 revision of this API.