Read a site's crawl settings, asked and effective
A site's crawl settings: config (what was asked for) and effective (what the next crawl will actually use), with demotions naming every difference and why. An unverified site crawls politely (2 at a time, 250 ms apart) as FrontshelfBot, with no credentials or custom headers, whatever config says: verified says which applies, and sites_verify changes it. max_urls is the page cap the crawl honours and where it comes from. Credential values are never returned. Next: configs_update to change a setting, crawls_start for a crawl under the effective settings.
Request
- Base URL: https://frontshelf.io/api
- URL: https://frontshelf.io/api/v1/sites/{site}/crawl-config
- Auth: HTTP bearer
Path parameters
Site ID (site_…), origin (https://example.com), or bare domain, resolved server-side; the response carries the canonical ID.
Response
Read a site's crawl settings, asked and effective
Changes
No recorded changes to this operation across all 1 revision of this API.