User-agent: * Disallow: /cgi-bin/ Disallow: /manual/ Disallow: /doc/ Disallow: /gif/ Disallow: /CFIDE/ Disallow: /printer.cfm/ Disallow: /welcome/ Disallow: /announcements/ Disallow: /webtools/admin-tools/ Disallow: /webtools/admin-tools/dba/ Disallow: /applications/ Disallow: /applications/secure/ Disallow: /netdirect/ # but allow htdig to index our doc-tree User-agent: susedig Disallow: # disallow stress test user-agent: stress-agent Disallow: /