Discussions
robots.txt in v. 2007.1
I've read every thread on robots.txt for versions prior to 2007.1, but have not seen anything about the subject for this release.
I am working on developing a 3 new sites that will replace 3 existing sites, and I don't want the NS sites to get indexed until we are ready to go.
Suggestions for robots.txt that I have seen do not appear to work, so I am placing meta tag "nofollow, noindex" entries in each site. But if there is a way to make robots.txt work in a multi-site 2007.1 environment, I'd love to know how to do it.
Thanks.