v2 · Agent-first crawler API

Custom Scrape

通用数据采集:任意 URL → warehouse-first 抓取 → 带 provenance 入指定 dataset。

post/api/v2/custom/scrape

Request

  • Base URL: https://smartcrawler.io (the document declares no server; this is the origin it was published from)
  • URL: https://smartcrawler.io/api/v2/custom/scrape
  • Auth: none declared

Headers

authorizationstring
X-API-Keystring

Request body

urlstring required
datasetstring required
entity_typestring
schemaobject nullable
force_liveboolean
save_policystring
max_age_secinteger nullable

Response

Successful Response

unknown required

Changes

No recorded changes to this operation across all 1 revision of this API.