robots.txt details

saved: size: 392 kb md5 checksum: 26c00508d9f0ddade243a715ea9e42f9

websites using this robots.txt

content


User-agent: *
Disallow: /comment/plugin/
Disallow: /comment/violation
Disallow: /profile/violation
Disallow: /polls/widgets/
Disallow: /articles/*/comments
Disallow: /articles/*/order
Sitemap: https://news.yahoo.co.jp/sitemaps.xml
Sitemap: https://news.yahoo.co.jp/sitemaps/article.xml
Sitemap: https://news.yahoo.co.jp/sitemaps/byline.xml
Sitemap: https://news.yahoo.co.jp/polls/sitemap.xml