robots.txt details

saved: size: 699 kb md5 checksum: 1d4aba496a3ddd3487c3adf780e4a154

websites using this robots.txt

content


User-agent: *
Disallow: /buscador/*?text=*
Disallow: /api/cms/
Disallow: /mdswebservice/
Disallow: /mdsvideo/
Disallow: /mdsads/
Disallow: /stats.html
Disallow: /api/boards
Disallow: /tags/*?text=*
Disallow: /autores/*?text=*
Disallow: /personajes/*?text=*
Disallow: /20e/
Disallow: /20n/
Disallow: /20o/
Disallow: /20p/
Disallow: /20r/
Disallow: /20s/
Disallow: /20v/

User-agent: FacebookBot
Crawl-delay: 10

User-agent: facebookexternalhit
Crawl-delay: 10

User-agent: msnbot
Disallow: *.shtml

User-agent: yaanibot
Disallow: /

Sitemap: https://www.telecinco.es/sitemap_index.xml
Sitemap: https://www.telecinco.es/sitemap_ampstories.xml
Sitemap: https://www.telecinco.es/sitemap_google_news.xml