---
title: "Web Fetch"
method: POST
path: "/web/enrich/live"
tags: ["Web APIs"]
---

# Web Fetch

`POST /web/enrich/live`

Fetch the HTML content of webpages given their URLs. Retrieves the page
title and full HTML content for up to 10 URLs in a single request. Use
this for content extraction, web content retrieval, data collection, content
monitoring, and SEO analysis.

<Note>
    Default `rate-limit` is 10 requests per minute. Send an email to [gtm@crustdata.co](mailto:gtm@crustdata.co) to discuss higher limits if needed for your use case.
</Note>

## Headers

- `x-api-version` '2025-11-01', required

## Request body

- WebFetchRequest — Request body for fetching webpage content.
  - `urls` string[], required — List of URLs to fetch web content for. Each URL must include the protocol prefix (http:// or https://). Maximum of 10 URLs per request.
  - `human_mode` boolean — Whether to use a browser-like retrieval path when standard access is blocked.

## Response `200`

Array of fetch results, one per URL. Each result includes a success flag. Failed URLs have null fields.

- WebFetchResult[] — Array of fetch results, one per URL in the request.
  - `success` boolean, nullable — Whether the content was fetched successfully for this URL.
  - `url` string, nullable — The URL that was fetched. Null if the fetch failed.
  - `timestamp` integer, nullable — Unix timestamp (seconds) of when the content was fetched. Null if the fetch failed.
  - `title` string, nullable — The title of the fetched webpage from the HTML title tag. Null if the fetch failed.
  - `content` string, nullable — The full HTML content of the fetched webpage. Null if the fetch failed.

## Other responses

- `400` — Invalid request — missing or invalid parameters.
- `401` — Missing or invalid API key.

---

[API](https://skmtc.dev/crustdata/apis/batch-api.md) · [All operations](https://skmtc.dev/crustdata/apis/batch-api/llms.txt) · [OpenAPI document](https://skmtc-service-production.skmtc.workers.dev/v1/apis/crustdata/batch-api/revisions/581689e66ae7/schema)