User-Agent: AhrefsBot Disallow: / Crawl-Delay: 60 User-agent: BLEXBot Disallow: / Crawl-Delay: 60 User-Agent: MJ12bot Disallow: / Crawl-Delay: 60 User-agent: SemrushBot Disallow: / Crawl-Delay: 60 User-agent: Baiduspider Disallow: / Crawl-Delay: 60 User-agent: PetalBot Disallow: / Crawl-Delay: 60