Generate robots.txt.

Returns a robots.txt generated from the project's Shield crawler policies.

This is what Shield serves for apps that have NO robots.txt of their own. An app that ships one has it served verbatim with these crawler rules appended instead, so this is not necessarily the file a crawler receives. You do not need to copy this into your project.