recommendations

Crawl Website

Crawl a brand's website to collect content for analysis.

This endpoint starts an asynchronous task to:

  1. Crawl all pages of the brand's website (up to max_pages)
  2. Extract structured content (title, headings, body text, keywords, etc.)
  3. Store content snapshots in the database for recommendation generation

Returns immediately with a task ID.

post/api/v1/brands/{brand_id}/crawl

Request

  • Base URL: https://geo.sig.ai (the document declares no server; this is the origin it was published from)
  • URL: https://geo.sig.ai/api/v1/brands/{brand_id}/crawl
  • Auth: HTTP bearer

Path parameters

brand_idstring uuid required

Cookies

access_tokenstring nullable

Request body

max_pagesinteger

Maximum number of pages to crawl (1-200)

Response

Successful Response

statusstring required

crawling, complete, failed

task_idstring required
estimated_time_secondsinteger
messagestring nullable
pages_to_crawlinteger nullable

Changes

No recorded changes to this operation across all 1 revision of this API.