---
title: "Robots"
method: HEAD
path: "/robots.txt"
---

# Robots

`HEAD /robots.txt`

Robots.txt — allow all crawlers, point at the sitemap, disallow internal endpoints.

## Response `200`

Successful Response

## Changes

- **2026-07-27** `2db38cc8922e` — 1 info
  - api operation id `robots_robots_txt_get` removed and replaced with `robots_robots_txt_head`

[Change history](https://skmtc.dev/oti-labs/apis/domain-intelligence-api/changes/robots.txt/head.md)

---

[API](https://skmtc.dev/oti-labs/apis/domain-intelligence-api.md) · [All operations](https://skmtc.dev/oti-labs/apis/domain-intelligence-api/llms.txt) · [OpenAPI document](https://skmtc-service-production.skmtc.workers.dev/v1/apis/oti-labs/domain-intelligence-api/revisions/2db38cc8922e/schema)