# Badly-programmed bot, downloading the same page every 12 seconds, for days and days... User-agent: FAST-WebCrawler Disallow: / # Hopelessly confused program User-agent: RufusBot Disallow: / # Drupal area User-agent: * Disallow: /Welcome/ # WTF are you doing with 2GB/month?!? User-agent: * Disallow: /Geo/ User-agent: Slurp Disallow: / User-agent: Turnitinbot Disallow: / User-agent: * Disallow: /cgi-bin User-agent: * Disallow: /Tools/Colours/PHP