# Inktomi (Anzwers, AOL, Canada.com, Hotbot, MSN, etc.) User-agent: slurp, crawl Disallow: / User-agent: * Disallow: /usercp* Disallow: /memberlist* Disallow: /member.php* Disallow: /calendar.php* Disallow: /online.php* Disallow: /modcp/ Disallow: /admincp/ Disallow: /register.php* Disallow: /private.php*