USER-AGENT: stress-agent Disallow: / USER-AGENT: * Disallow: /awstats/ Disallow: /cgi-bin/ Disallow: /cgi-stat/