CR

Crawler API

Pipelines

Web crawling: create and run crawlers, manage configs, monitor runs and URL stats

20 operations119 models53 revisions

Spec
OpenAPI 3.0.2
Document
raw.githubusercontent.com, YAML, 135 KB
Commit
b6c660b fix(specs): correct links to Algolia docs (#7134) (generated) [skip ci]
Published
Oct 9, 2026, 11:53 UTC
Retrieved
Oct 9, 2026, 12:02 UTC
Digest
fafe265d8562

For agents

Every page here has a markdown twin. The overview is one fetch; the llms.txt lists every operation with a link to its own markdown.

curl https://skmtc.dev/algolia/apis/crawler-api.md
curl https://skmtc.dev/algolia/apis/crawler-api/llms.txt