# file robots.txt for varsalona.com User-agent: * Disallow: /LOG/ Disallow: /film/ # but allow htdig to index our doc-tree #User-agent: susedig #Disallow: # disallow stress test user-agent: stress-agent Disallow: /