robots.txt details

50460118ff9b96f268e8b10e99b4eea5

saved: | size: 430kb | checksum: 50460118ff9b96f268e8b10e99b4eea5

websites using this robots.txt

content


Sitemap: https://www.bellaallurestudio.com/sitemap.xml

User-agent: Twitterbot
Disallow:

User-agent: *
Disallow: /cgi-bin/
Disallow: /keyword/
Crawl-delay: 3

User-agent: Yandex
User-agent: moget
User-agent: ichiro
User-agent: NaverBot
User-agent: Yeti
User-agent: Baiduspider
User-agent: Baiduspider-video
User-agent: Baiduspider-image
User-agent: sogou spider
User-agent: YoudaoBot
Disallow: /