Web Tools
Build robots.txt that treats search engines, AI answer bots and AI training crawlers separately; validate llms.txt.
robots.txt Builder & llms.txt Validator. Operations: build — Build robots.txt: allow or block search engines, AI answer engines/assistants and AI training crawlers (named), with Content-Signal and Sitemap lines. validate-llms — Check an llms.txt file against llmstxt.org: one H1, a > summary, H2 sections of Markdown link lists.
post/api/v1/robots-txt
Request
- Base URL: https://programmes.net
- URL: https://programmes.net/api/v1/robots-txt
- Auth: none declared
Request body
Response
The operation ran.
Changes
No recorded changes to this operation across all 1 revision of this API.