v2 · Agent-first crawler API

Batch Scrape

Batch scrape as a group of single URL calls.

The MVP returns inline results for the first 100 URLs. A webhook-backed async batch can be layered on top of the same service later.

post/api/v2/batch/scrape

Request

  • Base URL: https://smartcrawler.io (the document declares no server; this is the origin it was published from)
  • URL: https://smartcrawler.io/api/v2/batch/scrape
  • Auth: none declared

Headers

authorizationstring
X-API-Keystring

Request body

urlsstring[] required

URLs to scrape; max 100.

formatsstring[]
webhookstring nullable

Response

Successful Response

unknown required

Changes

No recorded changes to this operation across all 1 revision of this API.