# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file User-agent: Googlebot User-agent: Slurp User-agent: msnbot User-agent: Mediapartners-Google* User-agent: Googlebot-Image User-agent: Yahoo-MMCrawler Disallow: User-agent: * Disallow: /