# This is the robots.txt file. It can be used to indicate to # WWW robots which parts of a web site should not be indexed. # # Following page has details on how to setup a robots.txt file and # related security issues: # # http://www.chami.com/tips/internet/010198I.html # # All robots (*) should avoid the following directories: User-agent: * Disallow: /cgi-bin/ Disallow: /devel/ Disallow: /help/ Disallow: /images/ Disallow: /include/ Disallow: /inst/ Disallow: /members/ Disallow: /Templates/ Disallow: /test/ Disallow: /vef_logos/ # Examples: # Lines beginning with # are comments and are not used; if you add # lines, be sure they *do not* begin with #, like those above. # # Following two lines indicate that robots named "WWW_Robot_Name" # should stay away from this site. #User-agent: WWW_Robot_Name #Disallow: / # Following two lines indicate that robots named "WWW_Wanderer_Name" # should not index files in the /private/ folder. #User-agent: WWW_Wanderer_Name #Disallow: /private/