Several operations from one page visit

The sum of the operations it runs. Documentation: https://urlpipe.dev/docs/scrape

post/scrape

Request

  • Base URL: https://urlpipe.dev
  • URL: https://urlpipe.dev/scrape
  • Auth: HTTP bearer

Headers

Idempotency-Keystring

Makes a retry safe: the same key returns the first request's token and result instead of running again. https://urlpipe.dev/docs/retries

Request body

urlstring uri required

The page to fetch: a public http(s) URL.

syncboolean

Return the result in the response instead of a token.

report_tostring uri

Webhook URL the result is POSTed to (async requests).

labelsobject

Your own ids for this request, returned with the result and the webhook.

residentialboolean

Fetch from a home broadband address. +25 credits per page visit.

operationsstring[] required
device'mobile' | 'desktop'
instructionsstring

Guidance that applies to every field.

Response

With sync: true, the result. Without it, the request was accepted: a token to collect the result with.

urlstring
final_urlstring nullable

The address the page ended on, after its redirects.

operationsobject

One key per operation requested, in the order asked for.

Changes

No recorded changes to this operation across all 1 revision of this API.