Ahrefs Site Audit
SafeUser-agent: AhrefsSiteAudit
Category: SEO Tools
SEO impact if blocked: 2/10
2 crawlers operated by Ahrefs
https://ahrefs.com/Ahrefs operates 2 crawlers in our directory, filed under SEO Tools. Of those 2, 2 rated safe for crawl behaviour.
Blocking Ahrefs carries an SEO impact score of 0/10 to 2/10 across its crawlers. Every crawler here carries the same blocking impact: Low - No SEO ranking impact.
Our recommendation for Ahrefs, set by its least reassuring crawler (Ahrefs Site Audit, rated safe): Generally safe to allow; provides legitimate crawling value.
| Operator | Ahrefs |
|---|---|
| Crawlers in directory | 2 |
| Categories | SEO Tools |
| SEO impact if blocked | 0/10 to 2/10 |
| Crawl behaviour | 2 rated safe |
| Website | ahrefs.com |
| Official crawler docs | Ahrefs crawler documentation |
These rules cover all 2 crawlers Ahrefs operates. Add them to the robots.txt file at the root of your domain.
robots.txt is a request, not an enforcement mechanism. A crawler that ignores it needs a block at the server or CDN layer. Rules are case-sensitive on the path and matched against the user-agent token, not the full user-agent string.