# No Unauthorized Robots Allowed # Trespassers will be Prosecuted by Digital Millennium Copyright Act User-agent: * Disallow: /backup/ Disallow: /catalog/admin Disallow: /cgi-bin/ Disallow: /dev/ Disallow: /dev_old/ Disallow: /dev2/ Disallow: /old/ # add the rest of the sub-dir to disallow