Agent Docs

Well-known alias for the machine-readable robots and AI crawler policy.

Well-known alias for the machine-readable robots and AI crawler policy.

Inputs. No path or query fields are required. No request body is required.

Outputs. See each status below for its media type, schema and headers. A missing record or unavailable capability is not a successful empty result.

Errors. Read the status and Content-Type before decoding. Document, image, redirect and file routes need not return JSON errors.

Rate limits. Public read budgets apply by client IP and route group. This operation can have a smaller route-specific budget. Read Retry-After on 429 or retryable 503 responses.

get/.well-known/robots.json

Request

  • Base URL: https://huggingbay.xyz
  • URL: https://huggingbay.xyz/.well-known/robots.json
  • Auth: none declared

Response

Machine-readable robots policy

schemaVersion'hugging-bay.robots-json.v1' required
generatedAtstring required
baseUrlstring required
textRobotsUrlstring required
statusstring required
publicPolicyobject required
discoveryobject required
userAgentsobject[] required
providerGroupsobject[] required
allowPublicPathsstring[]
protectPrivatePathsstring[]
preferredCrawlEntrypointsstring[] required
preferredCitationTargetsstring[] required
expectedHeadersobject required
rateGuidanceobject required

Changes

No recorded changes to this operation across all 2 revisions of this API.