# /robots.txt file for http://www.wrek.org/ # mail webmaster@wrek.org for constructive criticism User-agent: * Disallow: /wreknet.html # The following example allows webcrawler to get anything # (by not disallowing anything) # # User-agent: webcrawler # Disallow: # # # The following example DIS-allows lycra from getting anything # # User-agent: lycra # Disallow: / # # # The following example disallows ANYONE from getting files from /tmp or /logs # # User-agent: * # Disallow: /tmp # Disallow: /logs