Exa AI Search: User Agent, robots.txt Rules & Safety Rating

Q: What user-agent string does Exa AI Search use?

Exa AI Search is reported to identify itself with ExaBot. That spelling comes from ai.robots.txt, not from Exa, which has not published crawler documentation naming it. Use it in robots.txt as the best available match, and treat a request carrying it as a clue rather than proof of who sent it.

Q: Is Exa AI Search safe?

Exa AI Search is rated Safe in this directory, meaning there are no credible public reports of abusive crawling under this name. It is a Reported token: Exa has not published documentation for it, so its purpose, crawl rate and robots.txt behaviour are not confirmed by the operator, and anyone can send the same user-agent string. Allow or block it on its stated purpose, and back the robots.txt rule with a firewall rule if the traffic matters to you.

Q: Will blocking Exa AI Search hurt my SEO?

✅ No SEO Impact - Blocking Exa AI Search does not affect your rankings in Google, Bing, or any other search engine. Exa AI Search is an AI crawler, not a traditional search indexer. You can freely block it via User-agent / Disallow: / without any SEO penalty.

Q: How do I block Exa AI Search in robots.txt?

Add the following lines to your /robots.txt file: User-agent: ExaBot Disallow: / This instructs Exa AI Search not to crawl any path on your site. To block only specific sections, replace / with the path (e.g., Disallow: /blog/).

Q: How do I verify if Exa AI Search is crawling my site?

Search your access logs for ExaBot (for example grep -i "ExaBot" /var/log/nginx/access.log). Because the operator publishes no IP ranges or reverse-DNS pattern, a match shows that something used the name, not that Exa sent it.

Quick Facts

User-Agent:: ExaBot
Category:: AI & LLM Bots
Operator:: Exa
Safety:: Safe
Blocking Impact:: Low - No SEO ranking impact
SEO Impact Score:: 2/10
Official docs:: None published by Exa
Named by:: ai.robots.txt

Reported, not operator documented

Exa has not published a crawler page that names ExaBot. It is listed here because a credible public source does: ai.robots.txt. Reported earlier Exa token; Exa now documents ExaSearchBot.

What that means for you: the robots.txt rule on this page is the best available spelling, and a well-behaved crawler using this string will honour it, but there is no vendor statement of purpose, crawl rate or robots.txt compliance to rely on. Treat a matching request in your logs as a detection clue, not proof of who sent it, and combine the rule with a firewall rule if the traffic matters to you. If the operator publishes documentation, this profile moves to Official docs.

What is Exa AI Search?

Exa AI Search is an AI search-index crawler operated by Exa. It collects and indexes web content so it can be surfaced as citations or answers inside Exa's AI search experience. Allowing Exa AI Search can increase your visibility in AI-powered search results, which is why most sites choose to permit it.

Exa AI Search is an AI search-index crawler operated by Exa. It collects and indexes web content so it can be surfaced as citations or answers inside Exa's AI search experience. Allowing Exa AI Search can increase your visibility in AI-powered search results, which is why most sites choose to permit it.
Exa AI Search uses the user-agent token ExaBot. You can control it via robots.txt, meta tags (noai), or the emerging llms.txt standard. Robots.txt is voluntary; for hard enforcement, combine it with server-level IP blocking.

What happens if you block Exa AI Search?

✅ No SEO Impact - Blocking Exa AI Search does not affect your rankings in Google, Bing, or any other search engine. Exa AI Search is an AI crawler, not a traditional search indexer. You can freely block it via User-agent / Disallow: / without any SEO penalty.

Generally safe to allow; provides legitimate crawling value.

ExaBot vs ExaSearchBot: which token Exa actually documents

ExaBot and ExaSearchBot compared
Question	ExaBot	ExaSearchBot
Documented by Exa?	No (Reported)	Yes (Official)
Request signing	Unknown	Web Bot Auth, RFC 9421 signatures
If robots.txt has no group for it	Unknown	Follows the rules you set for major search engines, otherwise *
Removing an indexed page	Not documented	Serve noindex; Exa removes it
Index scale	Not stated	1.4 trillion URLs, 100 billion pages (Exa)

That fallback matters: if you have a Googlebot group and no Exa group, Exa applies your Googlebot rules. To treat Exa differently, give ExaSearchBot its own group.

ExaBot use cases and a safe robots.txt

Use cases: what to do with this bot
If you are...	Recommended setting and why
A publisher who wants AI-app citations	Allow ExaSearchBot. Exa powers search inside many AI agents and developer tools, so its index is a retrieval source, not a training crawl.
A site that blocks all AI	Add an ExaSearchBot group with Disallow: /. A Googlebot-only allow list would otherwise let Exa in through the search-engine fallback.
Seeing "ExaBot" in logs	Check the signature or reverse DNS before trusting it; an unsigned request claiming to be Exa may be spoofed.

User-agent: ExaSearchBot
Allow: /
Disallow: /account/

Confirm the group with a crawler check and compare Exa with other AI search indexes in the Exa operator page.

Check Exa access on your site

AI crawler checker: tests 248 bots against your robots.txt in one scan.
AI crawler diagnostic: fetches a page as each AI bot and names the layer that blocks it.
robots.txt validator: shows allowed, blocked and partial status per bot.
robots.txt generator: builds a file with presets for search, agents and training.
batch URL checker: compares up to 20 sites side by side, with CSV export.
llms.txt generator: writes the file AI assistants read for a site summary.
schema markup generator: produces JSON-LD for eight common types.
GEO audit: scores a page for generative engine optimization.

How to block Exa AI Search with robots.txt

<code>User-agent: ExaBot</code> - Matching is case-insensitive. Robots.txt is fetched from the root of each subdomain separately.

Block completely (robots.txt)

User-agent: ExaBot
Disallow: /

Allow all (robots.txt)

User-agent: ExaBot
Allow: /

Block private only (robots.txt)

User-agent: ExaBot
Disallow: /private/
Disallow: /api/
Disallow: /admin/
Allow: /

Nginx server block

# Nginx: Hard-block Exa AI Search
if ($http_user_agent ~* "ExaBot") {
    return 403 "Bot blocked";
}

Apache .htaccess

# Apache: Hard-block Exa AI Search
SetEnvIfNoCase User-Agent "ExaBot" bad_bot
Order Allow,Deny
Allow from all
Deny from env=bad_bot

Meta robots tag

X-Robots-Tag header

X-Robots-Tag: noindex, nofollow

Is Exa AI Search safe to allow?

Exa AI Search is rated Safe in this directory, meaning there are no credible public reports of abusive crawling under this name. It is a Reported token: Exa has not published documentation for it, so its purpose, crawl rate and robots.txt behaviour are not confirmed by the operator, and anyone can send the same user-agent string. Allow or block it on its stated purpose, and back the robots.txt rule with a firewall rule if the traffic matters to you.

Exa publishes no IP ranges or reverse-DNS pattern for Exa AI Search, so the user-agent string cannot be verified. Rate-limit unusual volume instead of trusting the name.

What does Exa AI Search do?

Understanding Exa AI Search's purpose helps you decide whether to allow or block it.

Indexes web pages for AI-powered search answers
Surfaces your content as citations inside AI search results
Builds a knowledge index used to answer user questions
Allowing it can increase visibility in AI search
robots.txt behaviour not documented by the operator

Frequently Asked Questions

What user-agent string does Exa AI Search use?

Exa AI Search is reported to identify itself with ExaBot. That spelling comes from ai.robots.txt, not from Exa, which has not published crawler documentation naming it. Use it in robots.txt as the best available match, and treat a request carrying it as a clue rather than proof of who sent it.

Is Exa AI Search safe?

Exa AI Search is rated Safe in this directory, meaning there are no credible public reports of abusive crawling under this name. It is a Reported token: Exa has not published documentation for it, so its purpose, crawl rate and robots.txt behaviour are not confirmed by the operator, and anyone can send the same user-agent string. Allow or block it on its stated purpose, and back the robots.txt rule with a firewall rule if the traffic matters to you.

Will blocking Exa AI Search hurt my SEO?

✅ No SEO Impact - Blocking Exa AI Search does not affect your rankings in Google, Bing, or any other search engine. Exa AI Search is an AI crawler, not a traditional search indexer. You can freely block it via User-agent / Disallow: / without any SEO penalty.

How do I block Exa AI Search in robots.txt?

Add the following lines to your /robots.txt file:

User-agent: ExaBot
Disallow: /

This instructs Exa AI Search not to crawl any path on your site. To block only specific sections, replace / with the path (e.g., Disallow: /blog/).

Does Exa AI Search respect robots.txt?

Not documented. Exa has published no statement that Exa AI Search reads robots.txt. A rule for ExaBot will stop a client that chooses to honour it; for enforcement, add a firewall or CDN rule as well.

How do I verify if Exa AI Search is crawling my site?

Search your access logs for ExaBot (for example grep -i "ExaBot" /var/log/nginx/access.log). Because the operator publishes no IP ranges or reverse-DNS pattern, a match shows that something used the name, not that Exa sent it.

Is ExaBot the same as ExaSearchBot?

Exa documents ExaSearchBot, not ExaBot. ExaBot is a reported name from third-party lists. Use ExaSearchBot in robots.txt; Exa signs its requests with Web Bot Auth so real traffic can be verified.