Operated by Exa
Exa AI Search is an AI search-index crawler operated by Exa. It collects and indexes web content so it can be surfaced as citations or answers inside Exa's AI search experience. Allowing Exa AI Search can increase your visibility in AI-powered search results, which is why most sites choose to permit it.
Exa AI Search is an AI search-index crawler operated by Exa. It collects and indexes web content so it can be surfaced as citations or answers inside Exa's AI search experience. Allowing Exa AI Search can increase your visibility in AI-powered search results, which is why most sites choose to permit it.
Exa AI Search uses the user-agent token ExaBot. You can control it via robots.txt, meta tags (noai), or the emerging llms.txt standard. Robots.txt is voluntary; for hard enforcement, combine it with server-level IP blocking.
User-agent / Disallow: / without any SEO penalty.<code>User-agent: ExaBot</code> — Matching is case-insensitive. Robots.txt is fetched from the root of each subdomain separately.
Understanding Exa AI Search's purpose helps you decide whether to allow or block it.
ExaBot. Use this exact string in robots.txt, Nginx, Apache, or Cloudflare firewall rules to target this bot. Matching in robots.txt is case-insensitive. Verify a request genuinely comes from Exa AI Search by performing a reverse-DNS lookup on the source IP.User-agent / Disallow: / without any SEO penalty./robots.txt file:
User-agent: ExaBot Disallow: /This instructs Exa AI Search not to crawl any path on your site. To block only specific sections, replace / with the path (e.g.,
Disallow: /blog/)./robots.txt before crawling, following RFC 9309. For hard enforcement, combine robots.txt with server-level IP or user-agent blocking.ExaBot (case-insensitive: grep -i "ExaBot" /var/log/nginx/access.log). Filter by user-agent in your log analytics tool (GoAccess, AWStats, etc.).Check instantly with our free AI Bot Checker
Check Your Website