Public crawler policy for search and answer engines, including preferred crawl entrypoints and allowed user agents.

Public crawler policy for search and answer engines, including preferred crawl entrypoints and allowed user agents.

Inputs. No path or query fields are required. No request body is required.

Outputs. See each status below for its media type, schema and headers. A missing record or unavailable capability is not a successful empty result.

Errors. Read the status and Content-Type before decoding. Document, image, redirect and file routes need not return JSON errors.

Rate limits. Public read budgets apply by client IP and route group. This operation can have a smaller route-specific budget. Read Retry-After on 429 or retryable 503 responses.