# Google is our friend User-agent: googlebot Disallow: allow: / # Microsoft User-agent: msnbot Disallow: # Everyone else is limited to avoid traffic blowout # indexing all our publications # OFF FOR NOW # User-agent: * # Disallow: /cgi-bin/ # Disallow: /publications/ User-agent: * Disallow: /core/ Disallow: /dios/css/ Disallow: /dios/documents/ Disallow: /dios/js/ Disallow: /dios/lib/ Disallow: /dios/logs/ # Also limit indexing of print view pages User-agent: * Disallow: ?print Disallow: ?print=t