User-agent: TurnitinBot Disallow: / User-agent: MSIECrawler Disallow: / User-agent: NPBot Disallow: / User-agent: Nutch Disallow: / User-agent: semanticdiscovery Disallow: / User-agent: * Disallow: /utils/ Disallow: /cgi-bin/