robots.txt details

saved: size: 493 kb md5 checksum: 617955e208c15d2d246538e0d71b9a73

websites using this robots.txt

content


User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php

Disallow: /search/
Disallow: /*?s=*
Disallow: *&s=*
Disallow: /?p=*
Disallow: /amp-tealium/*
Disallow: /simwidgets/
Disallow: /app/
Disallow: /sso/login/
Disallow: /wp-login.php
Disallow: /video/
#Archive Sitemaps
Sitemap: https://www.the-sun.com/nav-sitemap.xml
Sitemap: https://www.the-sun.com/news-sitemap.xml


Disallow: /amp-tealium/
Disallow: /archives/

# Sitemap archive
Sitemap: https://www.the-sun.com/sitemap.xml