User-agent: *
Disallow: /cgi-bin/
Disallow: /webalizerhistoryory/

User-agent:  *
Crawl-delay:  5