batch

Start an async batch scrape over an explicit URL list

post/v1/batch/scrape

Request

  • Base URL: https://api.fastcrw.com
  • URL: https://api.fastcrw.com/v1/batch/scrape
  • Auth: one of:
    • HTTP bearer
    • none

Request body

urlsstring[] required

URLs to scrape. Each is SSRF-validated; invalid entries are reported in invalidUrls.

ignoreInvalidUrlsboolean

When false, a single invalid URL rejects the whole submit with 400.

maxConcurrencyinteger

How many URLs the job scrapes concurrently. Clamped server-side to crawler.max_batch_concurrency.

formatsOutputFormat[]
onlyMainContentboolean

Response

Batch job accepted; poll with /v1/batch/scrape/{id}

successboolean required
idstring required

Batch job id; poll with GET /v1/batch/scrape/{id}

invalidUrlsstring[] required

Submitted URLs rejected by parsing or the SSRF guard, verbatim.

Changes

No recorded changes to this operation across all 1 revision of this API.