How to get dynamic contents of robots.txt
I would like to retrieve the robots.txt content dynamically as it applies to all sites.
There does not seem to be support for the GET REST API functionality, only PUT. Since production is the only true environment this file is served and utilized, additional assurances would be welcome to make sure we do not break our site in production.
I'm aware we can retrieve them from https://<your site>/robots.txt, however this is the specific site map url for that site. For customers with multiple sites, this URL is different in each site.