v2 · Agent-first crawler API

Scrape

Single URL scrape with warehouse-first behavior.

post/api/v2/scrape

Request

  • Base URL: https://smartcrawler.io (the document declares no server; this is the origin it was published from)
  • URL: https://smartcrawler.io/api/v2/scrape
  • Auth: none declared

Headers

authorizationstring
X-API-Keystring

Request body

urlstring required

URL to scrape.

formatsstring[]

markdown / structured / html / links

only_main_contentboolean
wait_forinteger

Extra wait in milliseconds.

timeoutinteger

Timeout in milliseconds.

force_liveboolean

Bypass warehouse cache.

modestring

standard / advanced (browser_pool rendered scrape).

Response

Successful Response

unknown required

Changes

No recorded changes to this operation across all 1 revision of this API.