---
title: "The served robots.txt, corrected: * group rules copied into every named group that lacked them, a Sitemap line added when the file never named the sitemap it serves, a minimal replacement when the served file was HTML. Every change is listed at the top of the file"
method: GET
path: "/api/fix/robots"
---

# The served robots.txt, corrected: \* group rules copied into every named group that lacked them, a Sitemap line added when the file never named the sitemap it serves, a minimal replacement when the served file was HTML. Every change is listed at the top of the file

`GET /api/fix/robots`

## Request

- Base URL: `https://crawlcheck.io`
- URL: `https://crawlcheck.io/api/fix/robots`
- Auth: one of:
  - API key in header `x-crawlcheck-key`
  - none

## Query parameters

- `domain` string, required
- `format` 'json'

## Response `200`

text/plain robots.txt, or JSON when format=json

## Other responses

- `400`: No domain

---

[API](https://skmtc.dev/crawlcheck/apis/crawlcheck-api.md) · [All operations](https://skmtc.dev/crawlcheck/apis/crawlcheck-api/llms.txt) · [OpenAPI document](https://skmtc.dev/crawlcheck/apis/crawlcheck-api/revisions/57acbd6d4489?raw)