#robots.txt User-agent: Googlebot User-agent: Googlebot-News User-agent: Googlebot-Image User-agent: Googlebot-Video User-agent: Googlebot-Mobile User-agent: Mediapartners-Google User-agent: Adsbot-Google User-agent: bingbot User-agent: bing User-agent: Slurp User-agent: Twitterbot User-agent: ia_archiver User-agent: MSNBot Allow: / User-agent: * Disallow: /