# robots.txt for http://www.lildobe.net/ # # If you have any questions about indexing my site, # especially regarding more efficient or convenient # methods, please write to: # # webmaster@lildobe.net # #-------------------------- User-agent: * Disallow: /cgi-bin/ # EmailSiphon is a hunter/gatherer which extracts email addresses for spam-mailers to use User-agent: EmailSiphon Disallow: / User-agent: wget Disallow: /