Crawl

Start a website crawl

Enqueue a crawl of the given root URL for the workspace in X-Workspace-ID. The crawler discovers pages via sitemap + link graph, classifies each page (product, product listing, or general content), and indexes products into savanto-products and content into savanto-posts. This call is asynchronous and returns immediately with a crawlId; poll GET /crawl/{crawlId}/status to track progress or subscribe to the email notification endpoint to be pinged when it completes. Starting a new crawl while one is already running for the same workspace will be rejected with 409 — cancel the running one first.

post/crawl

Request

  • Base URL: https://api.savanto.ai
  • URL: https://api.savanto.ai/crawl
  • Auth: HTTP bearer

Request body

urlstring required
workspaceIdstring
maxPagesinteger
isOnboardingboolean
strategy'full' | 'smart'
trigger'manual' | 'scheduled'

Example request

{
  "url": "https://example.com"
}

Response

Crawl started

Changes

No recorded changes to this operation across all 1 revision of this API.