# do not allow all robots to scan some directories User-agent: * Disallow: /cgi-bin/ Disallow: /JSPWiki/ Disallow: /HOM/