robots.txt details

saved: size: 311 kb md5 checksum: a52ebc1cc48bc920b93bb17f4680d2a0

websites using this robots.txt

content


User-agent: *
Disallow: /caas/
Disallow: /_td_api
Disallow: /tdv2_fp
Disallow: /nel_ms
Disallow: /fp_ms
Disallow: /sports_fp_ms
Disallow: /search_ms

Sitemap: https://news.yahoo.com/sitemaps/news-sitemap_index_US_en-US.xml.gz
Sitemap: https://news.yahoo.com/sitemaps/news-sitemap_googlenewsindex_US_en-US.xml.gz