User-agent: * Disallow: #Directory restrictions Disallow: /cgi-bin/ Disallow: /Uploads/ #Specific restrictions User-agent: architext Disallow: /User-agent: infoseek Disallow: /User-agent: msnbot Disallow: /User-agent: robozilla Disallow: /User-agent: scooter Disallow: /User-agent: slurp Disallow: /User-agent: yahoo-slurp Disallow: /User-agent: twiceler Disallow: /User-agent: gigabot Disallow: /User-agent: AboutUsBot Disallow: /