Robots.txt — allow all crawlers, point at the sitemap, disallow internal endpoints.
Successful Response