AI & LLM Bots Directory

AI training crawlers collecting content for LLM datasets. Blocking has zero SEO impact.

88 tokens
85 profiles
65 safe
18 caution
2 aggressive

Common providers

Pick a provider to see only its crawlers. Each provider also has a full profile under Bot Operators.

All 88 AI & LLM Bots

88 user-agent tokens on 85 profiles. 3 unversioned tokens are covered on the profile of their versioned twin, so searching either spelling finds the same card.

FAQ

How many AI & LLM Bots are tracked?
We currently track 88 user-agent tokens in AI & LLM Bots, documented on 85 profile pages with user-agent strings, safety ratings and blocking rules. 3 unversioned tokens share a profile with their versioned twin.
Which AI & LLM Bots should I never block?
Never block bots with 'critical' impact rating - there are 0 in this category. Blocking them removes your site from their search results.
Are all AI & LLM Bots safe?
Out of the 85 profiles in this category: 65 safe, 18 caution, 2 aggressive.
How do I block all AI & LLM Bots at once?
Generate a combined robots.txt block rule for all AI & LLM Bots using our bulk robots.txt generator, or manually list each User-agent + Disallow: / directive.