Web

Anti-bot check — website scraping difficulty

Probes a URL across escalating transports (direct HTTP → browser-impersonation → headless/stealth browsers) and returns an empirical scraping-difficulty assessment for that exact URL: a 0–10 difficulty_score and difficulty_band (easy, medium, hard, very_hard, blocked, unknown), whether it is scrapeable, the detected anti-bot protections (Cloudflare, DataDome, Akamai, PerimeterX, Kasada, Imperva, AWS WAF and more — each with a kind and confidence), the lightest transport that worked, and a recommended_profile. Difficulty is per-URL, not per-site — a homepage may be open while deep pages are bot-managed. Intended for authorized public-data scraping planning.

post/diagnostics/antibot-check

Request

  • Base URL: https://api.crawlora.net/api/v1
  • URL: https://api.crawlora.net/api/v1/diagnostics/antibot-check
  • Auth: API key in header x-api-key

Headers

x-api-keystring required

API key required

Request body

fastboolean

Fast (default true) escalates cheapest-transport-first and returns at the first tier that retrieves the page, so an unprotected page never spins up a browser. Set false for an exhaustive multi-run sweep across every backend.

urlstring required

URL is the absolute http/https target to assess.

Example request

{
  "url": "https://www.crunchbase.com/organization/snowflake-computing"
}

Response

OK

codeinteger
msgstring

Example response

{
  "code": 200,
  "msg": "OK"
}

Changes

No recorded changes to this operation across all 2 revisions of this API.