User-agent: SemrushBot
Crawl-delay: 10
User-agent: DotBot
Crawl-delay: 10
User-agent: dotbot
Crawl-delay: 10
User-agent: AhrefsBot
Crawl-delay: 10
User-agent: YandexBot
Crawl-delay: 10
User-agent: GPTBot
Crawl-delay: 10
User-agent: MJ12bot
Crawl-delay: 30
User-agent: PetalBot
Crawl-delay: 30
User-agent: ClaudeBot
Crawl-delay: 30