---
title: "Robots Check Ep"
method: POST
path: "/analyze/robots"
tags: ["analyze"]
---

# Robots Check Ep

`POST /analyze/robots`

## Request

- Base URL: `https://api.xeorank.com` (the document declares no server; this is the origin it was published from)
- URL: `https://api.xeorank.com/analyze/robots`
- Auth: API key in header `X-Agent-Key`

robots.txt as a crawler reads it: raw file, parsed groups, Sitemap lines,
and an allowed/blocked matrix for search and AI bots (Googlebot, Bingbot,
GPTBot, OAI-SearchBot, PerplexityBot, ClaudeBot, Claude-SearchBot,
Google-Extended, CCBot …) over the homepage plus any URLs given. Also reports
/llms.txt. Any public domain, no crawl.

## Query parameters

- `email` string, nullable

## Request body

- SiteFetchRequest
  - `domain` string, required
  - `urls` string[], nullable
  - `bots` string[], nullable
  - `max_urls` integer, nullable
  - `status_sample` integer, nullable
  - `path` string, nullable

## Response `200`

Successful Response

- object

## Other responses

- `422`: Validation Error

---

[API](https://skmtc.dev/xeorank/apis/seo-intelligence-engine.md) · [All operations](https://skmtc.dev/xeorank/apis/seo-intelligence-engine/llms.txt) · [OpenAPI document](https://skmtc.dev/xeorank/apis/seo-intelligence-engine/revisions/449a3fd73454?raw)