robots.txt details

c2094c2eb4eb02944c7c62af59709513

saved: | size: 378kb | checksum: c2094c2eb4eb02944c7c62af59709513

websites using this robots.txt

content

#robots.txt
User-agent: Googlebot
User-agent: Googlebot-News
User-agent: Googlebot-Image
User-agent: Googlebot-Video
User-agent: Googlebot-Mobile
User-agent: Mediapartners-Google
User-agent: Adsbot-Google
User-agent: bingbot
User-agent: bing
User-agent: Slurp
User-agent: Twitterbot
User-agent: ia_archiver
User-agent: MSNBot
Allow: /

User-agent: *
Disallow: /