---
title: "Start a website crawl"
method: POST
path: "/api/v1/chatbots/{id}/knowledge/crawl"
---

# Start a website crawl

`POST /api/v1/chatbots/{id}/knowledge/crawl`

## Request

- Base URL: `https://smartwebchat.eu`
- URL: `https://smartwebchat.eu/api/v1/chatbots/{id}/knowledge/crawl`
- Auth: HTTP bearer

Discovers pages of the website, then waits for confirmation (job status awaiting_confirmation). Same URL safety, quota and crawl-start limit as the dashboard.

## Path parameters

- `id` string, required

## Headers

- `Idempotency-Key` string

## Request body

- object
  - `url` string, required

## Response `202`

Crawl started; data.job

## Other responses

- `400`: URL missing or not allowed
- `402`: Knowledge quota used up
- `404`: Chatbot not found
- `409`: A request with this Idempotency-Key is still being processed. Retry after the seconds given in Retry-After (2).
- `422`: Idempotency-Key was already used with a different request body. Use a new key for a new request.
- `429`: Rate limit exceeded: 600 requests per minute per account across all /api/v1/ routes. Wait for the seconds given in Retry-After (60) and retry.

---

[API](https://skmtc.dev/smartwebchat/apis/smartwebchat-api.md) · [All operations](https://skmtc.dev/smartwebchat/apis/smartwebchat-api/llms.txt) · [OpenAPI document](https://skmtc.dev/smartwebchat/apis/smartwebchat-api/revisions/1b052502dacb?raw)