Scrape

Scrape a URL and Wait for the Result

Scrapes a single URL and returns the result in the same response, so no polling is needed. Takes the same body as POST /url-scraper. If the scrape takes longer than about 90 seconds, the response is a 202 with an id and a non-terminal status; fetch the result later with GET /url-scraper/{jobId}. A failed scrape also returns 200 with status: "failed", so check status. Limited to 20 requests per minute.

post/url-scraper/scrape

Request

  • Base URL: https://api.anakin.io/v1
  • URL: https://api.anakin.io/v1/url-scraper/scrape
  • Auth: API key in header X-API-Key

Request body

urlstring uri required

The full URL of the website to extract data from.

countrystring

Proxy country code, e.g. us, gb, de.

useBrowserboolean

Use a headless browser — best for JS-heavy sites.

generateJsonboolean

AI-extract structured JSON from the page content.

forceFreshboolean

Bypass the cache and force a fresh extraction.

sessionIdstring

Reuse an existing authenticated browser session (see Browser Sessions) instead of an anonymous request.

sessionNamestring

Human-readable name of a saved browser session — alternative to sessionId.

Example request

{
  "url": "https://example.com"
}

Response

Scrape finished (completed or failed)

idstring

Job ID.

urlstring

The URL that was scraped.

status'pending' | 'processing' | 'completed' | 'failed'
cachedboolean

Whether this result was served from cache.

durationMsinteger

Extraction duration in milliseconds.

markdownstring

Page content as clean markdown (populated when the default markdown format is used).

generatedJsonobject

AI-extracted structured JSON — populated only when generateJson was true.

errorstring

Populated only when status is failed.

Changes

No recorded changes to this operation across all 1 revision of this API.