---
title: "Get discovered URLs"
method: GET
path: "/sitemap/{jobId}/urls"
tags: ["Sitemap"]
---

# Get discovered URLs

`GET /sitemap/{jobId}/urls`

## Request

- Base URL: `https://request.usestring.ai/v1`
- URL: `https://request.usestring.ai/v1/sitemap/{jobId}/urls`
- Auth: HTTP bearer

Return a page of the URLs a sitemap job discovered, with each URL's depth, parent and discovery source. It works mid-crawl and `total` grows as the crawl runs; check getSitemapJob to know when the set is complete. Also served under `/map` with the same shapes.

## Query parameters

- `limit` integer
- `offset` integer

## Response `200`

Results page returned.

- SitemapUrlPage
  - `jobId` string, required
  - `total` integer, required: URLs discovered so far. Grows while the crawl runs; check job status to know when the set is complete.
  - `urls` SitemapUrl[], required
    - `url` string: The discovered URL.
    - `statusCode` integer: HTTP status from fetching the URL; 0 when the fetch failed or the code wasn't retained.
    - `discoveredUrls` integer: New URLs found on this page. Omitted once results are served from durable storage.
    - `depth` integer: Link depth from the starting URL (0 = seed).
    - `isSitemap` boolean: Whether this URL is a sitemap file rather than a page.
    - `error` string: Present when fetching this URL failed.
    - `parentUrl` string, nullable: The URL this one was discovered on.
    - `sourceType` 'seed' | 'sitemap_index' | 'sitemap_urlset' | 'html_link': How the URL was discovered.

## Other responses

- `401`: Missing or invalid Authorization header.
- `404`: Job not found or expired.

---

[API](https://skmtc.dev/usestring/apis/string-web-access-api.md) · [All operations](https://skmtc.dev/usestring/apis/string-web-access-api/llms.txt) · [OpenAPI document](https://skmtc.dev/usestring/apis/string-web-access-api/revisions/fd336960036e?raw)