User-agent: Jakarta Commons-HttpClient*
Disallow: /

User-agent: Microsoft URL Control
Disallow: /


User-agent: Slurp
Disallow: /


User-agent: *
Disallow: /