User-agent: * Disallow: /cgi-bin/ Disallow: /logs/ Disallow: /test.html User-agent: WebReaper Disallow: /