---
title: "Custom Scrape"
method: POST
path: "/api/v2/custom/scrape"
tags: ["v2 · Agent-first crawler API"]
---

# Custom Scrape

`POST /api/v2/custom/scrape`

## Request

- Base URL: `https://smartcrawler.io` (the document declares no server; this is the origin it was published from)
- URL: `https://smartcrawler.io/api/v2/custom/scrape`
- Auth: none declared

通用数据采集:任意 URL → warehouse-first 抓取 → 带 provenance 入指定 dataset。

## Headers

- `authorization` string
- `X-API-Key` string

## Request body

- CustomScrapeRequest
  - `url` string, required
  - `dataset` string, required
  - `entity_type` string
  - `schema` object, nullable
  - `force_live` boolean
  - `save_policy` string
  - `max_age_sec` integer, nullable

## Response `200`

Successful Response

- unknown

## Other responses

- `422`: Validation Error

---

[API](https://skmtc.dev/smartcrawler/apis/smart-crawler-ai-agent.md) · [All operations](https://skmtc.dev/smartcrawler/apis/smart-crawler-ai-agent/llms.txt) · [OpenAPI document](https://skmtc.dev/smartcrawler/apis/smart-crawler-ai-agent/revisions/a0eb313934e4?raw)