# /www/*/robots.txt Last changed: 30-Apr-2010 # The robots.txt file indicates which webcrawler accesses are # not to be allowed, because we do not wish to index this info. # For information about the robots.txt file format, see the URL # http://info.webcrawler.com/mak/projects/robots/norobots.html User-agent: * # End of robots.txt file.