Sitemap

Get discovered URLs

Return a page of the URLs a sitemap job discovered, with each URL's depth, parent and discovery source. It works mid-crawl and total grows as the crawl runs; check getSitemapJob to know when the set is complete. Also served under /map with the same shapes.

get/sitemap/{jobId}/urls

Request

  • Base URL: https://request.usestring.ai/v1
  • URL: https://request.usestring.ai/v1/sitemap/{jobId}/urls
  • Auth: HTTP bearer

Query parameters

limitinteger

Page size.

offsetinteger

Number of entries to skip.

Response

Results page returned.

jobIdstring required
totalinteger required

URLs discovered so far. Grows while the crawl runs; check job status to know when the set is complete.

Changes

No recorded changes to this operation across all 1 revision of this API.