map

Discover URLs on a site

post/v1/map

Request

  • Base URL: https://api.fastcrw.com
  • URL: https://api.fastcrw.com/v1/map
  • Auth: one of:
    • HTTP bearer
    • none

Request body

urlstring uri required
maxDepthinteger

Maximum link-follow depth from the start URL

useSitemapboolean

Fetch and parse sitemap.xml first

crawlFallbackboolean

Fall back to BFS crawl when sitemap is missing or sparse

timeoutinteger

Custom timeout in seconds (default: 120)

Response

List of URLs

successboolean required

Changes

No recorded changes to this operation across all 1 revision of this API.