# Notice: if you would like to crawl DomainTools you can # contact us here: http://www.domaintools.com/company/contact/ # to apply for white listing. User-agent: Mediapartners-Google Disallow: /go/ Disallow: /dmoz/ Disallow: /redirect/ Disallow: /index.html? Disallow: /index.php? Disallow: /google-search/ Disallow: /seo-browser/ Disallow: /feed/ Disallow: /- Disallow: /logout/ Disallow: /corporate/ Disallow: /research/traceroute/?query= Disallow: /research/ping/?query= Disallow: /research/dns/?query= User-agent: Googlebot Disallow: /go/ Disallow: /dmoz/ Disallow: /redirect/ Disallow: /index.html? Disallow: /index.php? Disallow: /google-search/ Disallow: /seo-browser/ Disallow: /feed/ Disallow: /- Disallow: /logout/ Disallow: /corporate/ Disallow: /research/traceroute/?query= Disallow: /research/ping/?query= Disallow: /research/dns/?query= User-agent: Bingbot Disallow: /go/ Disallow: /dmoz/ Disallow: /redirect/ Disallow: /index.html? Disallow: /index.php? Disallow: /google-search/ Disallow: /seo-browser/ Disallow: /feed/ Disallow: /- Disallow: /logout/ Disallow: /corporate/ Disallow: /research/traceroute/?query= Disallow: /research/ping/?query= Disallow: /research/dns/?query= User-agent: msnbot Disallow: /go/ Disallow: /dmoz/ Disallow: /redirect/ Disallow: /index.html? Disallow: /index.php? Disallow: /google-search/ Disallow: /seo-browser/ Disallow: /feed/ Disallow: /- Disallow: /logout/ Disallow: /corporate/ Disallow: /research/traceroute/?query= Disallow: /research/ping/?query= Disallow: /research/dns/?query= User-agent: Slurp Disallow: /go/ Disallow: /dmoz/ Disallow: /redirect/ Disallow: /index.html? Disallow: /index.php? Disallow: /google-search/ Disallow: /seo-browser/ Disallow: /feed/ Disallow: /- Disallow: /logout/ Disallow: /corporate/ Disallow: /research/traceroute/?query= Disallow: /research/ping/?query= Disallow: /research/dns/?query= User-agent: teoma Disallow: /go/ Disallow: /dmoz/ Disallow: /redirect/ Disallow: /index.html? Disallow: /index.php? Disallow: /google-search/ Disallow: /seo-browser/ Disallow: /feed/ Disallow: /- Disallow: /logout/ Disallow: /corporate/ Disallow: /research/traceroute/?query= Disallow: /research/ping/?query= Disallow: /research/dns/?query= User-agent: baiduspider Disallow: /go/ Disallow: /dmoz/ Disallow: /redirect/ Disallow: /index.html? Disallow: /index.php? Disallow: /google-search/ Disallow: /seo-browser/ Disallow: /feed/ Disallow: /- Disallow: /logout/ Disallow: /corporate/ Disallow: /research/traceroute/?query= Disallow: /research/ping/?query= Disallow: /research/dns/?query= User-agent: facebookexternalhit/* Disallow: /go/ Disallow: /dmoz/ Disallow: /redirect/ Disallow: /index.html? Disallow: /index.php? Disallow: /google-search/ Disallow: /seo-browser/ Disallow: /feed/ Disallow: /- Disallow: /logout/ Disallow: /corporate/ Disallow: /research/traceroute/?query= Disallow: /research/ping/?query= Disallow: /research/dns/?query= User-agent: sogou Disallow: /go/ Disallow: /dmoz/ Disallow: /redirect/ Disallow: /index.html? Disallow: /index.php? Disallow: /google-search/ Disallow: /seo-browser/ Disallow: /feed/ Disallow: /- Disallow: /logout/ Disallow: /corporate/ Disallow: /research/traceroute/?query= Disallow: /research/ping/?query= Disallow: /research/dns/?query= User-agent: naverbot Disallow: /go/ Disallow: /dmoz/ Disallow: /redirect/ Disallow: /index.html? Disallow: /index.php? Disallow: /google-search/ Disallow: /seo-browser/ Disallow: /feed/ Disallow: /- Disallow: /logout/ Disallow: /corporate/ Disallow: /research/traceroute/?query= Disallow: /research/ping/?query= Disallow: /research/dns/?query= User-agent: seznambot Disallow: /go/ Disallow: /dmoz/ Disallow: /redirect/ Disallow: /index.html? Disallow: /index.php? Disallow: /google-search/ Disallow: /seo-browser/ Disallow: /feed/ Disallow: /- Disallow: /logout/ Disallow: /corporate/ Disallow: /research/traceroute/?query= Disallow: /research/ping/?query= Disallow: /research/dns/?query= User-agent: Yandex Disallow: /go/ Disallow: /dmoz/ Disallow: /redirect/ Disallow: /index.html? Disallow: /index.php? Disallow: /google-search/ Disallow: /seo-browser/ Disallow: /feed/ Disallow: /- Disallow: /logout/ Disallow: /corporate/ Disallow: /research/traceroute/?query= Disallow: /research/ping/?query= Disallow: /research/dns/?query= User-agent: Blekkobot Disallow: /go/ Disallow: /dmoz/ Disallow: /redirect/ Disallow: /index.html? Disallow: /index.php? Disallow: /google-search/ Disallow: /seo-browser/ Disallow: /feed/ Disallow: /- Disallow: /logout/ Disallow: /corporate/ Disallow: /research/traceroute/?query= Disallow: /research/ping/?query= Disallow: /research/dns/?query= User-agent: DuckDuckBot Disallow: /go/ Disallow: /dmoz/ Disallow: /redirect/ Disallow: /index.html? Disallow: /index.php? Disallow: /google-search/ Disallow: /seo-browser/ Disallow: /feed/ Disallow: /- Disallow: /logout/ Disallow: /corporate/ Disallow: /research/traceroute/?query= Disallow: /research/ping/?query= Disallow: /research/dns/?query= User-agent: YodaoBot Disallow: /go/ Disallow: /dmoz/ Disallow: /redirect/ Disallow: /index.html? Disallow: /index.php? Disallow: /google-search/ Disallow: /seo-browser/ Disallow: /feed/ Disallow: /- Disallow: /logout/ Disallow: /corporate/ Disallow: /research/traceroute/?query= Disallow: /research/ping/?query= Disallow: /research/dns/?query= User-agent: SurveyBot Disallow: /go/ Disallow: /dmoz/ Disallow: /redirect/ Disallow: /index.html? Disallow: /index.php? Disallow: /google-search/ Disallow: /seo-browser/ Disallow: /feed/ Disallow: /- Disallow: /logout/ Disallow: /corporate/ Disallow: /research/traceroute/?query= Disallow: /research/ping/?query= Disallow: /research/dns/?query= User-agent: * Disallow: /