# Exclusions for web crawlers # (see also http://www.robotstxt.org/wc/norobots.html) # User-agent: * Disallow: /cgi-bin # RT23950 User-agent: Slurp Disallow: /cgi-bin Disallow: /~fpirmin/ Disallow: /~kreuzerb/