User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /search/ Disallow: /*?s=* Disallow: *&s=* Disallow: /?p=* Disallow: /amp-tealium/* Disallow: /simwidgets/ Disallow: /app/ Disallow: /sso/login/ Disallow: /wp-login.php Disallow: /video/ #Archive Sitemaps Sitemap: https://www.the-sun.com/nav-sitemap.xml Sitemap: https://www.the-sun.com/news-sitemap.xml Disallow: /amp-tealium/ Disallow: /archives/ User-agent: CCBot Disallow: / User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: anthropic-ai Disallow: / User-agent: cohere-ai Disallow: / User-agent: ia_archiver Disallow: / User-agent: omgili Disallow: / User-agent: omgilibot Disallow: / User-agent: MJ12bot Disallow: / User-agent: PiplBot Disallow: / # Sitemap archive Sitemap: https://www.the-sun.com/sitemap.xml