URL to markdown

PDF URLs auto-route to the document parser (metadata.parser=pdf-inspector).

post/scrape

Request

  • Base URL: https://fastcrawl.net/api/v1
  • URL: https://fastcrawl.net/api/v1/scrape
  • Auth: HTTP bearer

Request body

urlstring uri required
formatsstring[]

Output formats. changeTracking adds metadata.change_information: {change_status: first|unchanged|added|removed|different, diff} vs your previous scrape of this URL.

maxAgeinteger

Cache freshness window seconds (default 172800 = 48h; 0=always fresh). Cache hits are free.

timeoutinteger

Per-page timeout in seconds (5-30, default 30). Fail fast on blocking pages. Capped at 30 to bound browser-rendering cost per credit.

fetchMode'auto' | 'http'

Response

Scraped content.

successboolean
urlstring
markdownstring
htmlstring
linksstring[]
jsonobject
metadataobject

incl. change_information when formats has changeTracking; parser=pdf-inspector for PDFs

duration_msinteger
from_cacheboolean
errorstring
error_code'target_dns_error' | 'target_unreachable' | 'target_timeout' | 'target_tls_error' | 'target_redirect_loop' | 'target_blocked' | 'target_not_found' | 'target_rate_limited' | 'target_server_error' | 'scrape_http_status' | 'scrape_invalid_url' | 'scrape_engine_error' | 'scrape_antibot_error' | 'scrape_pdf_detected' | 'scrape_empty_content' | 'unknown_format' | 'invalid_request' | 'invalid_api_key' | 'missing_api_key' | 'monthly_limit' | 'daily_limit' | 'rate_limit'
retryableboolean

true: timeout/unreachable/rate-limit/engine errors — retry helps. false: dns/404/blocked/tls/redirect-loop — do not retry.

Changes

No recorded changes to this operation across all 1 revision of this API.