---
title: "Generate robots.txt."
method: GET
path: "/v1/shield/robots-txt"
tags: ["Shield"]
---

# Generate robots.txt.

`GET /v1/shield/robots-txt`

## Request

- Base URL: `https://api.scalix.world`
- URL: `https://api.scalix.world/v1/shield/robots-txt`
- Auth: HTTP bearer

Returns a `robots.txt` generated from the project's Shield crawler policies.

This is what Shield serves for apps that have NO robots.txt of their own.
An app that ships one has it served verbatim with these crawler rules
appended instead, so this is not necessarily the file a crawler receives.
You do not need to copy this into your project.

## Response `200`

Generated robots.txt for the project

## Other responses

- `401`: Missing or invalid credentials
- `403`: Token lacks the waf:read scope or is not project-scoped
- `500`: Internal error

---

[API](https://skmtc.dev/scalix/apis/scalix-cloud-api.md) · [All operations](https://skmtc.dev/scalix/apis/scalix-cloud-api/llms.txt) · [OpenAPI document](https://skmtc.dev/scalix/apis/scalix-cloud-api/revisions/2c04ca0a90bb?raw)