SEO & Publishing

robots.txt + llms.txt checker

robots.txt + llms.txt checker: crawler access verdicts for major search AND AI bots (Googlebot, Bingbot, GPTBot, ClaudeBot, PerplexityBot, CCBot, Google-Extended and more), declared sitemaps, syntax warnings, and llms.txt / llms-full.txt presence with structure summary. ?url=any page on the site

Price: $0.001 per call, paid in USDC via the x402 protocol (see the x402 security scheme).

get/api/seo/robots-check

Request

  • Base URL: https://api.webbersites.com
  • URL: https://api.webbersites.com/api/seo/robots-check
  • Auth: API key in header X-PAYMENT

Query parameters

urlstring required

Domain or any page on it

Response

Success

originstring
robotsobject
llms_txtobject

Changes

No recorded changes to this operation across all 1 revision of this API.