User-Agent: * Crawl-Delay: 1 Disallow: /mirrors/