sitemap

Sitemap and Robots.txt Doctor: Audit Crawl Files

Audit a website's robots.txt and XML sitemaps in one call: user-agent groups and blocked paths, sitemap declarations, whether each sitemap loads, URL counts (indexes followed to 10 files), lastmod coverage and age, duplicates, off-host and non-HTTPS URLs, size-limit breaches, and a sample of listed URLs checked for status. Returns a list of concrete issues.

get/v1/sitemap-robots-doctor

Request

  • Base URL: https://api.ambolt.dev
  • URL: https://api.ambolt.dev/v1/sitemap-robots-doctor
  • Auth: none required

Query parameters

sitestring required

Domain or URL of the site, for example example.com or https://example.com/blog.

sampleUrlsinteger

How many listed URLs to fetch and check for status (0 to skip).

free'1'

Set to 1 for one free call per tool and IP address per day (no payment).

Response

Result (JSON). Every result names its source and the time it was read.

object required

Changes

No recorded changes to this operation across all 1 revision of this API.