---
title: "Resolve every named answer engine, search index and training crawler against a domain's robots.txt the way a crawler does: most-specific group only, longest match, allow wins a tie"
method: GET
path: "/api/tool/robots"
---

# Resolve every named answer engine, search index and training crawler against a domain's robots.txt the way a crawler does: most-specific group only, longest match, allow wins a tie

`GET /api/tool/robots`

## Request

- Base URL: `https://crawlcheck.io`
- URL: `https://crawlcheck.io/api/tool/robots`
- Auth: none required

## Query parameters

- `domain` string, required
- `path` string

## Response `200`

Per agent: allowed at the path, allowed_root, named, shadowed

- object

## Other responses

- `400`: No domain

---

[API](https://skmtc.dev/crawlcheck/apis/crawlcheck-api.md) · [All operations](https://skmtc.dev/crawlcheck/apis/crawlcheck-api/llms.txt) · [OpenAPI document](https://skmtc.dev/crawlcheck/apis/crawlcheck-api/revisions/57acbd6d4489?raw)