Web

Read a page as markdown

Any public page rendered and turned into clean markdown (main content only by default), with its title and description — and the page's links if you ask. Use it to quote sources, read documentation, pull facts for a script. Pages behind a login cannot be read. When the provider cannot read a page (or is out) the page is fetched and read by us instead, at no provider cost; via says which.

Billing: 1 provider credit per page · Rate limit: 60/min

post/v1/web/scrape

Request

  • Base URL: https://apihub.co.il
  • URL: https://apihub.co.il/v1/web/scrape
  • Auth: HTTP bearer

Headers

Idempotency-Keystring

Replay-safe: the same execution is returned instead of charging twice

X-Tagstring

Group calls into one job (e.g. one video) — see GET /v1/usage?tag=…

Request body

urlstring uri required

The page to read

linksboolean

Also return the links on the page

max_age_secondsinteger

A copy fetched within this many seconds is fine (faster, cheaper); 0 = always fresh

only_main_contentboolean

Drop menus, footers and ads

Response

Completed

idstring

Execution id — stable across internal retries; use it with GET /v1/executions/{id}

status'pending' | 'processing' | 'completed' | 'partial' | 'failed' | 'cancelled' | 'timeout'
operationstring
tagstring nullable

Your X-Tag, if sent

created_atstring date-time
completed_atstring date-time nullable
outputobject

Operation result (see each operation). While a Studio render is processing: stage (queued · transcribing · downloading · preparing · cleaning_voice · mixing_audio · rendering · finishing), phase (the engine's: download · prepare · voice · audio · encode · qa · upload, or null), progress (a percent, 0–100) and progress_fraction (0–1), eta_seconds (seconds left, never below 0) and estimate_seconds

errorstring nullable

Changes

No recorded changes to this operation across all 2 revisions of this API.