You're almost there! Please answer a few more questions for access to the Applications content. Complete registration
Interested in joining? Complete your registration by providing Areas of Interest here. Register

How to get dynamic contents of robots.txt

Accepted answer
62
Views
5
Comments
in Commerce 5 comments

Summary:

Similar to https://community.oracle.com/customerconnect/discussion/comment/769609

I would like to retrieve the robots.txt content dynamically as it applies to all sites.

Content (required):

There does not seem to be support for the GET REST API functionality, only PUT. Since production is the only true environment this file is served and utilized, additional assurances would be welcome to make sure we do not break our site in production.

I'm aware we can retrieve them from https://<your site>/robots.txt, however this is the specific site map url for that site. For customers with multiple sites, this URL is different in each site.

Tagged:

Howdy, Stranger!

Log In

To view full details, sign in.

Register

Don't have an account? Click here to get started!