- Run by
- Mistral
- Type
- AI training crawler
- Visits
- On its own schedule
- robots.txt
- Follows robots.txt
- robots.txt name
MistralAI-Training- Documentation
- Mistral's page
What MistralAI-Training does
MistralAI-Training crawls public web content to build datasets for training Mistral's generative AI models. Mistral says it isn't used for search indexing or for answering live questions.
Does MistralAI-Training follow robots.txt?
Yes. Mistral says webmasters can disallow MistralAI-Training in robots.txt. It describes no other opt-out.
How to block or allow MistralAI-Training
Block it from the whole site:
User-agent: MistralAI-Training
Disallow: /Keep it out of one folder only:
User-agent: MistralAI-Training
Disallow: /private/ A crawler that finds a group with its own name follows only that group and ignores User-agent: *. If your * group disallows paths such as /admin/, repeat those lines in the MistralAI-Training group. robots.txt works per host, so add the rules to each subdomain you want covered.
Test the result with the robots.txt checker, or write a new file with the robots.txt generator.
What blocking MistralAI-Training changes
Mistral stops collecting your content for model training. Its search and live answers use other bots, so blocking this one alone keeps you in them.
Where to see MistralAI-Training visits
Most bots never appear in Google Analytics. Many don't run JavaScript, so the analytics tag never loads, and Google Analytics 4 automatically excludes traffic from known bots and spiders. Your server or CDN logs record every request with its user agent, so search them for the bot's name.
OneLence AI visibility shows which pages AI crawlers read and fetch for answers, next to the visitors AI assistants send you and the ones that convert.
Other bots from Mistral
- MistralAI-User: MistralAI-User fetches a page when someone asks Mistral's assistant a question that needs it. Mistral says it doesn't crawl on its own or collect training data.
- MistralAI-Index: MistralAI-Index crawls the web to build the index behind Mistral's search. Mistral says what it crawls isn't used for AI training.
Frequently asked questions
What is MistralAI-Training?
MistralAI-Training crawls public web content to build datasets for training Mistral's generative AI models. Mistral says it isn't used for search indexing or for answering live questions.
Does MistralAI-Training follow robots.txt?
Yes. Mistral says webmasters can disallow MistralAI-Training in robots.txt. It describes no other opt-out.
How do I block MistralAI-Training?
Add a group to robots.txt with User-agent: MistralAI-Training, then Disallow: /.
What happens if I block MistralAI-Training?
Mistral stops collecting your content for model training. Its search and live answers use other bots, so blocking this one alone keeps you in them.
Why doesn't MistralAI-Training show up in Google Analytics?
Most bots never appear in Google Analytics. Many don't run JavaScript, so the analytics tag never loads, and Google Analytics 4 automatically excludes traffic from known bots and spiders. Your server or CDN logs record every request with its user agent, so search them for the bot's name.