Data

Scrape website content

Scrape a URL using a headless browser and return content in one or more formats. Defaults to ["markdown", "metadata"]. Multiple formats can be requested in a single call.

post/api/data/{project_id}/scrape

Request

  • Base URL
    https://core.blink.new
  • URL
    https://core.blink.new/api/data/{project_id}/scrape
  • Auth
    HTTP bearer

Path parameters

project_idstring required
Example:my-project-123

Unique identifier for the project

Request body

urlstring uri required

URL of the website to scrape

formatsstring[]

Output formats to return. Available formats: markdown (clean text), html (cleaned HTML), rawHtml (raw HTML), links (extracted links), extract (structured content), metadata (page metadata)

Example request

{
  "url": "https://example.com"
}

Response

Website content scraped successfully

markdownstring

Clean markdown representation of the page content

htmlstring

Cleaned HTML content (scripts and styles removed)

rawHtmlstring

Raw HTML content as received from the server

Example response

{
  "markdown": "# Page Title\n\nThis is the main content of the page...",
  "html": "<h1>Page Title</h1><p>This is the main content...</p>",
  "rawHtml": "<!DOCTYPE html><html><head>...</head><body>...</body></html>"
}

Changes

No recorded changes to this operation across all 1 revision of this API.