Robots

Robots: explicit AI crawler rules + allow query endpoints; disallow dump-style.

head/robots.txt

Request

  • Base URL: https://petforai.com (the document declares no server; this is the origin it was published from)
  • URL: https://petforai.com/robots.txt
  • Auth: none declared

Response

Successful Response

Changes

No recorded changes to this operation across all 1 revision of this API.