Ahrefs

2 crawlers operated by Ahrefs

https://ahrefs.com/

Who Ahrefs is, for site owners

Ahrefs operates 2 crawlers in our directory, filed under SEO Tools. Of those 2, 2 rated safe for crawl behaviour.

Blocking Ahrefs carries an SEO impact score of 0/10 to 2/10 across its crawlers. Every crawler here carries the same blocking impact: Low - No SEO ranking impact.

Our recommendation for Ahrefs, set by its least reassuring crawler (Ahrefs Site Audit, rated safe): Generally safe to allow; provides legitimate crawling value.

Ahrefs at a glance

OperatorAhrefs
Crawlers in directory2
CategoriesSEO Tools
SEO impact if blocked0/10 to 2/10
Crawl behaviour2 rated safe
Websiteahrefs.com
Official crawler docsAhrefs crawler documentation

Crawlers operated by Ahrefs

How to block or allow Ahrefs in robots.txt

These rules cover all 2 crawlers Ahrefs operates. Add them to the robots.txt file at the root of your domain.

Block Ahrefs completely
User-agent: AhrefsSiteAudit User-agent: AhrefsBot Disallow: /
Allow Ahrefs explicitly
User-agent: AhrefsSiteAudit User-agent: AhrefsBot Allow: /

robots.txt is a request, not an enforcement mechanism. A crawler that ignores it needs a block at the server or CDN layer. Rules are case-sensitive on the path and matched against the user-agent token, not the full user-agent string.

Frequently asked questions about Ahrefs

What crawlers does Ahrefs run?
Ahrefs operates 2 crawlers in our directory: Ahrefs Site Audit (user-agent AhrefsSiteAudit), AhrefsBot (user-agent AhrefsBot).
Should I block Ahrefs?
Generally safe to allow; provides legitimate crawling value. That guidance follows this operator's least reassuring crawler, Ahrefs Site Audit, rated safe, because allowing an operator allows every crawler it runs. The SEO impact score for blocking is 0/10 to 2/10, where 10 means blocking costs you the most visibility.
How do I block Ahrefs in robots.txt?
Add the following to robots.txt at your domain root: User-agent: AhrefsSiteAudit then User-agent: AhrefsBot then Disallow: /. One Disallow line covers all 2 user-agent tokens.
Does blocking Ahrefs hurt my search rankings?
Every crawler here carries the same blocking impact: Low - No SEO ranking impact. Google's own ranking crawler is Googlebot, which this operator does not run, so blocking Ahrefs does not by itself remove you from Google's index. What it can change is whether AI assistants and analytics tools can read your pages.