robots.txt details

saved: size: 1224 kb md5 checksum: 5bd9b10fa10a74b34b083b8a32817dad

websites using this robots.txt

content


# Hi there,
# You're sniffing around this file, and you're not a robot, it means you are a curious person.
#
# As always, Asimov's Three Laws are in effect:
# 1. A robot may not injure a human being or, through inaction, allow a human being to come to harm.
# 2. A robot must obey orders given it by human beings except where such orders would conflict with the First Law.
# 3. A robot must protect its own existence as long as such protection does not conflict with the First or Second Law.
#
# Go on, don't stop here, there are more people on this planet.
# This message was left by Nicolae NAGHI, in the 3th of January, 2020 when robots were left to haunt themselves, and AI was not a threat.
#
# You Are Still Here?
# Take a look at humans.txt, if there is.

User-agent: *
Disallow: */utilizator/
Disallow: */request/
Disallow: */price-*/
Disallow: */sort-*/
Disallow: */smvftol/
Disallow: /sitemap-index-old.xml
Disallow: /old_listing_bijuterii.xml.gz
Disallow: /xold_listing_bijuterii.xml.gz
Disallow: /old_listing_bijuterii.xml.gz
Disallow: /old_listing_ceasuri.xml.gz
Disallow: /old_listing_cosmetice.xml.gz
Disallow: /old_listing_curele_accesorii_decor.xml.gz


Sitemap: https://www.bb-shop.ro/sitemap-all-index.xml