User-agent: * Disallow: us.html Disallow: /admin/ Disallow: /cgi-bin/ Disallow: /spammers-are-leeches Disallow: /get-a-job-parasite # look at http://www.robotstxt.org/wc/robots.html