robots.txt details

710a5d4b9cd2705cf2e44affcdf7d8ba

saved: | size: 544kb | checksum: 710a5d4b9cd2705cf2e44affcdf7d8ba

websites using this robots.txt

content

User-agent: Mediapartners-Google
Disallow:

User-agent: *
Crawl-Delay: 5

Disallow: /__r_frontend_dev.php
Disallow: /__r_frontend_dev.php/
Disallow: /apply-job/
Disallow: /recommend-job/
Disallow: /email-job/
Disallow: /job-bookmark/
Noindex: /application-signup-new/
Noindex: /external-application-signup/
Disallow: /application-signup-new/
Disallow: /external-application-signup/
Noindex: /qa-post-login/
Disallow: /qa-post-login/


Allow: /

Sitemap: http://www.renewableenergyjobs.com/uploads/portal/www.renewableenergyjobs.com/sitemap.xml