---
title: "Get Scrapes Metadata"
method: GET
path: "/list_scrapes"
---

# Get Scrapes Metadata

`GET /list_scrapes`

## Request

- Base URL: `https://api.datafuel.dev`
- URL: `https://api.datafuel.dev/list_scrapes`
- Auth: HTTP bearer

## Query parameters

- `job_id` string, nullable: Optional job ID to filter scrapes
- `markdown` boolean: If true, return markdown data on top of the signed_url
- `ai_response` boolean: If true, return AI response data on top of the signed_url
- `url` string, nullable: If provided, filter scrapes by the given URL

## Response `200`

Successful Response

- ScrapeMetadata[]
  - `job_id` string, required: The unique identifier for the scraping job that can contain multiple scrapes
  - `scrape_id` string, nullable: The unique identifier for the each URL scrape
  - `scrape_status` 'pending' | 'failed' | 'success', required
  - `scrape_url` string, required: The URL that was scraped
  - `scrape_timestamp` string, required: The timestamp of when the scrape was created
  - `signed_url` string, nullable: Pre-signed URL containing the scraping results in JSON format with structure: { "ai_response": "AI-generated analysis or structured data", "markdown": "Content formatted in markdown", "html": "Raw HTML content from the scraped page" }
  - `ai_response` string, nullable: AI-generated analysis or structured data
  - `markdown` string, nullable: Content formatted in markdown
  - `job_status` 'pending' | 'finished', required

## Other responses

- `401`: Unauthorized
- `404`: Not Found
- `422`: Validation Error

---

[API](https://skmtc.dev/datafuel/apis/datafuel-api.md) - [All operations](https://skmtc.dev/datafuel/apis/datafuel-api/llms.txt) - [OpenAPI document](https://skmtc.dev/datafuel/apis/datafuel-api/revisions/aff86ad8da21?raw)