MistralAI-Index: what it is and how to block or allow it

What MistralAI-Index does

MistralAI-Index crawls the web automatically to build the index behind Mistral search, which Mistral's assistant uses to answer questions. Mistral says it crawls for indexing only, and that its content isn't used for generative AI training of any kind.

Does MistralAI-Index follow robots.txt?

Mistral lists MistralAI-Index among the robots.txt names webmasters can use to manage its crawlers.

How to block or allow MistralAI-Index

Block it from the whole site:

User-agent: MistralAI-Index
Disallow: /

Keep it out of one folder only:

User-agent: MistralAI-Index
Disallow: /private/

A crawler that finds a group with its own name follows only that group and ignores User-agent: *. If your * group disallows paths such as /admin/, repeat those lines in the MistralAI-Index group. robots.txt works per host, so add the rules to each subdomain you want covered.

Test the result with the robots.txt checker, or write a new file with the robots.txt generator.

What blocking MistralAI-Index changes

Your pages are left out of Mistral's search index, so its assistant is less likely to surface or cite them.

Where to see MistralAI-Index visits

Most bots never appear in Google Analytics. Many don't run JavaScript, so the analytics tag never loads, and Google Analytics 4 automatically excludes traffic from known bots and spiders. Your server or CDN logs record every request with its user agent, so search them for the bot's name.

OneLence AI visibility shows which pages AI crawlers read and fetch for answers, next to the visitors AI assistants send you and the ones that convert.

Other bots from Mistral

• MistralAI-User: MistralAI-User fetches a page when someone asks Mistral's assistant a question that needs it. Mistral says it doesn't crawl on its own or collect training data.
• MistralAI-Training: MistralAI-Training collects public web content to train Mistral's AI models. Blocking it doesn't remove you from Mistral's search or answers.