User-agent: SemrushBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: 008 Disallow: / User-agent: BLEXBot Disallow: / User-agent: sistrix Disallow: / User-agent: ia_archiver Disallow: / User-agent: proximic Disallow: / User-agent: SiteExplorer Crawl-delay: 30 User-agent: MSNBot Crawl-delay: 7 User-agent: Bingbot Crawl-delay: 7