Mistral Search Index

Mistral Search Index in context

Mistral Search Index is a retrieval crawler that feeds AI search answers operated by Mistral AI. In plain terms, it builds a search or answer index. Our database files it under AI and LLM crawlers and ranks it Tier 2, important crawlers from established AI and search operators. 74 of the 104 AI and LLM crawlers in our database share this tier.

Its safety rating is safe and its blocking impact is low. So the decision about Mistral Search Index rests on what you want from Mistral AI, not on its behaviour. How we rate safety and impact.

How site owners treat Mistral Search Index

Our robots.txt study of the Tranco top 10,000 did not track MistralAI-Index as a named token, so we do not publish an adoption figure for it. If you run a large site, your own logs are the best evidence of how often it visits.

Does it follow robots.txt?

Mistral Search Index's operator says it follows robots.txt, so a correctly written Mistral Search Index group is enough to control it.

Mistral AI crawlers and close alternatives

Mistral Search Index is one of 4 Mistral AI crawlers in our database. A User-agent: MistralAI-Index group controls Mistral Search Index only; the other Mistral AI tokens below need their own lines.

• MistralAI-Index: this crawler (Tier 2)
• MistralAI-Training: Mistral Training, collects pages to train AI models (Tier 2)
• MistralAI-User: Mistral AI (Vibe), fetches a page when a person asks an assistant or app to open it (Tier 2)
• MistralAI-User-1.0: Mistral AI v1, fetches a page when a person asks an assistant or app to open it (Tier 2)

To give Mistral Search Index the same answer as its siblings, stack User-agent: MistralAI-Index with their lines above one set of rules; to treat Mistral Search Index differently, give it its own group.

Other AI and LLM crawlers that do the same job (builds a search or answer index) include AddSearchBot from AddSearch, AIWebIndex from Lyrenth, atlassian-bot from Atlassian, AzureAI-SearchBot from Microsoft, Cloudflare-AI-Search from Cloudflare, Cloudflare-AutoRAG from Cloudflare. Deciding about Mistral Search Index is usually a decision about the whole group, so check how your file treats these too.

We first recorded MistralAI-Index on May 31, 2026. Mistral AI documents it on docs.mistral.ai, and we recheck that page before each release.

Which rule Mistral Search Index actually follows

Mistral Search Index reads exactly one group in robots.txt, the most specific one that names MistralAI-Index, and never combines rules across groups. This short file shows the trap:

User-agent: *
Disallow: /private/

User-agent: MistralAI-Index
Disallow: /drafts/

1. Find the group. Mistral Search Index looks for a group naming MistralAI-Index. One exists, so it ignores User-agent: * completely.
2. Apply only that group. It is refused /drafts/ and nothing else.
3. The surprise. /private/ is open to Mistral Search Index, because that rule lives in the * group it no longer reads. To keep it out of both, repeat Disallow: /private/ inside its own group.

Should you allow Mistral Search Index? Decide by situation

Check Mistral Search Index on your own site

1. Open /robots.txt on your domain and search for MistralAI-Index. If it is not named, it follows User-agent: *.
2. List the Disallow lines in the group Mistral Search Index follows and test your key URLs against them; the longest match wins, and Allow wins a tie.
3. Look beyond the file. A firewall or bot manager can refuse Mistral Search Index even when robots.txt allows it, and that never shows in the file.
4. Run our AI search crawlability check to see how Mistral Search Index and every other crawler we track are treated in one pass, including firewall refusals.