---
title: "GET /web-scraper"
method: GET
path: "/web-scraper"
tags: ["WebScraper"]
---

# GET /web-scraper

`GET /web-scraper`

## Request

- Base URL: `https://scrappa.co/api`
- URL: `https://scrappa.co/api/web-scraper`
- Auth: API key in header `X-API-KEY`

Fetch any URL and extract structured data including title, meta description, keywords, favicon, social links, all links on the page, emails, phone numbers, images, body text, and detected languages. Meta keywords are always a JSON array of strings: content="php,,laravel" returns data.keywords=["php","laravel"]. Empty entries are omitted, remaining order and duplicates are preserved, and missing or all-empty metadata returns []. Set javascript=true for client-rendered pages. In JSON responses, url is the requested URL (with a protocol added if omitted), and final_url is the destination after redirects. Relative links, image URLs, and favicons are resolved against final_url, preserving non-default ports. Query-only references keep the page path: ?page=2 at https://example.com/catalog/page?old=1 resolves to https://example.com/catalog/page?page=2. Relative dot segments are normalized: /catalog/../item becomes /item and /catalog/./item becomes /catalog/item. Reference queries and fragments are preserved. Default HTTP(S) ports may be omitted from resolved relative URLs. Only HTTP(S) destinations are returned; absolute HTTP(S) references are left unchanged. If the destination URL is unavailable, the URL used for the fetch is returned. Returns the site's HTTP status code separately so you can distinguish site errors (404, 500) from infrastructure errors. Use response_type=markdown to get only the page content as clean markdown.

## Query parameters

- `url` string, required
- `include_html` boolean, nullable
- `javascript` boolean, nullable
- `response_type` 'json' | 'markdown' | 'null', nullable

## Response `200`

- string

## Other responses

- `400`: The url parameter is not a valid absolute URL or domain.
- `401`: Unauthorized - API key is missing or invalid
- `422`: Required parameters failed request validation.
- `500`
- `503`: The upstream service is temporarily unavailable. Please retry shortly.

---

[API](https://skmtc.dev/scrappa/apis/scrappa-api-documentation.md) · [All operations](https://skmtc.dev/scrappa/apis/scrappa-api-documentation/llms.txt) · [OpenAPI document](https://skmtc.dev/scrappa/apis/scrappa-api-documentation/revisions/1e1aa78ff103?raw)
