AI Crawler Check
Free Bot Analysis Tool
Check
Home / Directory / SEO Tools

SEO Tools Directory

Commercial SEO platform crawlers (Ahrefs, Semrush etc.). Blocking hides your data from competitors.

21 total
18 safe
3 caution
0 aggressive

AhrefsBot

Safe
User-agent: AhrefsBot
Operator: Ahrefs

AudigentAdBot

Safe
User-agent: AudigentAdBot
Operator: Audigent

AwarioRssBot

Safe
User-agent: AwarioRssBot
Operator: Awario

AwarioSmartBot

Safe
User-agent: AwarioSmartBot
Operator: Awario

Brandwatch

Safe
User-agent: Brandwatch
Operator: Brandwatch

Chrome-Lighthouse

Safe
User-agent: Chrome-Lighthouse
Operator: Google

DataForSeoBot

Safe
User-agent: DataForSeoBot
Operator: DataForSEO

DotBot

Caution
User-agent: DotBot
Operator: Moz

Google Page Speed Insights

Safe
User-agent: Google Page Speed Insights
Operator: Google

Jetslide

Safe
User-agent: Jetslide
Operator: Unknown

MJ12bot

Caution
User-agent: MJ12bot
Operator: Majestic

Meltwater

Safe
User-agent: Meltwater
Operator: Meltwater

NeticleBot

Safe
User-agent: NeticleBot
Operator: Neticle

Netvibes

Safe
User-agent: Netvibes
Operator: Unknown

Screaming Frog SEO Spider

Safe
User-agent: Screaming Frog SEO Spider
Operator: Screaming Frog

SearchmetricsBot

Safe
User-agent: SearchmetricsBot
Operator: Searchmetrics

SemrushBot

Safe
User-agent: SemrushBot
Operator: Semrush

SemrushBot-OCOB

Caution
User-agent: SemrushBot-OCOB
Operator: Semrush

SemrushBotSwa

Safe
User-agent: SemrushBotSwa
Operator: Semrush

Sidetrade Indexer Bot

Safe
User-agent: Sidetrade Indexer Bot
Operator: Sidetrade

peer39_crawler

Safe
User-agent: peer39_crawler
Operator: Unknown

FAQ

How many SEO Tools are tracked?
We currently track 21 SEO Tools with user-agent strings, safety ratings, and blocking rules.
Which SEO Tools should I never block?
Never block bots with 'critical' impact rating — there are 0 in this category. Blocking them removes your site from their search results.
Are all SEO Tools safe?
Out of 21 bots in this category: 18 safe, 3 caution, 0 aggressive.
How do I block all SEO Tools at once?
Generate a combined robots.txt block rule for all SEO Tools using our bulk robots.txt generator, or manually list each User-agent + Disallow: / directive.