Batch scrape

Up to 50 URLs, 10-wide parallel, same pipeline as /scrape (formats, cache, PDF auto-route, changeTracking). Plan limits checked once up front. Failed requests are never charged.

post/batch/scrape

Request

  • Base URL: https://fastcrawl.net/api/v1
  • URL: https://fastcrawl.net/api/v1/batch/scrape
  • Auth: HTTP bearer

Request body

urlsstring[] required
formatsstring[]

Output formats. changeTracking adds metadata.change_information: {change_status: first|unchanged|added|removed|different, diff} vs your previous scrape of this URL.

maxAgeinteger
timeoutinteger

Per-page timeout in seconds (5-30, default 30), applied to each URL in the batch.

fetchMode'auto' | 'http'

Response

Per-item results (aligned to input order) + totals.

successboolean
totalinteger
succeededinteger
failedinteger

Changes

No recorded changes to this operation across all 1 revision of this API.