Web Tools

Build robots.txt that treats search engines, AI answer bots and AI training crawlers separately; validate llms.txt.

robots.txt Builder & llms.txt Validator. Operations: build — Build robots.txt: allow or block search engines, AI answer engines/assistants and AI training crawlers (named), with Content-Signal and Sitemap lines. validate-llms — Check an llms.txt file against llmstxt.org: one H1, a > summary, H2 sections of Markdown link lists.

post/api/v1/robots-txt

Request

  • Base URL: https://programmes.net
  • URL: https://programmes.net/api/v1/robots-txt
  • Auth: none declared

Request body

OR

Response

The operation ran.

okunknown required
tool'robots-txt' required
operation'build' | 'validate-llms' required
resultunknown required

Changes

No recorded changes to this operation across all 1 revision of this API.