crawl

Submit Crawl

Submit a URL for crawling. Crawls the website, extracts data, analyzes with LLM, saves to DB, and returns the tool profile.

post/api/crawl

Request

  • Base URL: https://bizclaw.xyz (the document declares no server; this is the origin it was published from)
  • URL: https://bizclaw.xyz/api/crawl
  • Auth: OAuth 2 (password, token URL /api/auth/login)

Query parameters

track_jobboolean
adaptive_retryboolean

Request body

urlstring uri required

Response

Successful Response

unknown required

Changes

No recorded changes to this operation across all 1 revision of this API.