#User-agent: * sets the rule for ALL search engine spiders User-agent: * #Disallow: /cgi-bin/ this stops the search engine spider indexing all items in this folder Disallow: /cgi-bin/ Disallow: /art/ Disallow: /artwork/ Disallow: /oldpages/ Disallow: /textart/ #Created by Adrian Turner 29.06.05