User-agent: * # directed to all spiders Allow: Index.html Disallow: /cgi-bin/ Disallow: /logs/ Disallow: /images/ Disallow: /leak stop_files/ Disallow: /safedata/ Disallow: /wavefile/ Disallow: /safedat.htm Disallow: /sidenote.htm