# Block useless bots who drive up our load average
User-Agent: The Knowledge AI
Disallow: /

User-agent: AhrefsBot
Disallow: /

User-agent: centurybot
Disallow: /

User-agent: SemrushBot
Disallow: /

User-agent: DataForSeoBot
Disallow: /

User-agent: Riddler
Disallow: /

User-agent: *
Crawl-Delay: 10
Disallow: