User-agent: * Disallow: Disallow: /?i=eworx.en.earnings-reports Sitemap: http://www.eworx.gr/google # block some "evil" robots - TLP-524 User-agent: 008 Disallow: / User-agent: AhrefsBot Disallow: / User-agent: BLP_bbot/0.1 Disallow: / # slow down some bots User-agent: msnbot Crawl-delay: 2