now also available for firefox

robots.txt details

3fa9135eade44b92b617646632d33435

saved: | size: 1054kb | checksum: 3fa9135eade44b92b617646632d33435

websites using this robots.txt

content

User-agent: *
Noindex:/catalog/SearchDisplay/*
Noindex:/catalog/SearchDisplay?*
Noindex:/catalog/ProductDisplay/
Noindex:/catalog/ProductDisplay/*
Noindex:/catalog/ProductDisplay?*
Noindex:/catalog/CategoryDisplay/
Noindex:/catalog/CategoryDisplay/*
Noindex:/catalog/CategoryDisplay?*
Noindex:/catalog/EmersonProductListingView?
Noindex:/wcsstore/*
Noindex:/DCX/*
Noindex:/SiteCollectionImages/*
Noindex:/SiteCollectionDocuments/*
Noindex:/SiteCollectionDocuments/*
Disallow:/*-_-
Disallow:*/UserRegistrationForm
Disallow:*/EmersonPackageAndProductListingView
Disallow:*/EmersonSiteContentListView
Disallow:*/EmersonAssemblyListingView
Disallow:*/EmersonSKUListingView
Noindex:/*asset-detail
Disallow:/webapp*
Allow:/webapp/wcs/stores/servlet/sitemap
Noindex:*/404-not-found
Crawl-delay: 120

Sitemap: https://www.emerson.com/service/sitemap/emerson-electric-en-us/sitemap_index.xml
Sitemap: https://www.emerson.com/service/sitemap/emerson-electric-shared/sitemap_index.xml
Sitemap: https://www.emerson.com/webapp/wcs/stores/servlet/sitemap_20151.xml.gz