WE

WebCrawler API

Web crawling: crawl sites, scrape pages to markdown, run feeds and agents to extract structured data

Swagger 2.0Commercial26 operations16 schemas1 revision

Changes

Full history
Updated on 2026-10-13

Source

View schema
Document
api.webcrawlerapi.com · JSON, 70 KB
Retrieved
Oct 13, 2026
Digest
214170dc104e

For agents

Every page here has a markdown twin. The overview is one fetch; the llms.txt lists every operation with a link to its own markdown.

curl https://skmtc.dev/webcrawlerapi/apis/webcrawler-api.md
curl https://skmtc.dev/webcrawlerapi/apis/webcrawler-api/llms.txt