# Allow Google to search news center articles but nothing else User-agent: Googlebot Allow: /news/ Disallow: / # Allow MSN to search news center articles but nothing else User-agent: MSNBot Allow: /news/ Disallow: / #Allow fae evaluator User-agent: Wget Disallow: /cgi-bin/ # All other crawlers go away User-agent: * Disallow: /