---
title: "Crawler permissions and discovery pointers for search, answer engines, and agent clients."
method: GET
path: "/robots.txt"
tags: ["Agent Docs"]
---

# Crawler permissions and discovery pointers for search, answer engines, and agent clients.

`GET /robots.txt`

## Request

- Base URL: `https://huggingbay.xyz`
- URL: `https://huggingbay.xyz/robots.txt`
- Auth: none declared

Crawler permissions and discovery pointers for search, answer engines, and agent clients.

**Inputs.** No path or query fields are required. No request body is required.

**Outputs.** See each status below for its media type, schema and headers. A missing record or unavailable capability is not a successful empty result.

**Errors.** Read the status and Content-Type before decoding. Document, image, redirect and file routes need not return JSON errors.

**Rate limits.** Public read budgets apply by client IP and route group. This operation can have a smaller route-specific budget. Read Retry-After on 429 or retryable 503 responses.

## Response `200`

Robots text

---

[API](https://skmtc.dev/huggingbay/apis/hugging-bay-public-api.md) · [All operations](https://skmtc.dev/huggingbay/apis/hugging-bay-public-api/llms.txt) · [OpenAPI document](https://skmtc.dev/huggingbay/apis/hugging-bay-public-api/revisions/ea7ba26b1e27?raw)