robots.txt details

6a8468ec55144f2536221d62fde5d722

saved: | size: 538kb | checksum: 6a8468ec55144f2536221d62fde5d722

websites using this robots.txt

content

User-agent: Yandex
User-agent: sogou
User-agent: TurnitinBot
User-agent: VeBot
User-agent: Cliqzbot
User-agent: BLEXBot
Disallow: /

User-agent: AhrefsBot
Crawl-Delay: 300

User-agent: Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)
User-agent: msnbot
User-agent: Bingbot
User-agent: MSNBot
User-agent: MSNBot-Media
User-agent: AdIdxBot
User-agent: BingPreview
Crawl-delay: 5

User-agent: *
Disallow: /account/
Disallow: /cart/
Disallow: /api/
Disallow: /checkout/
Sitemap: http://sitemap.linio.com/cl/sitemap.xml