- Run by
- Mistral
- Type
- AI assistant fetcher
- Visits
- When a person does something that needs your page
- robots.txt
- Follows robots.txt
- robots.txt name
MistralAI-User- Documentation
- Mistral's page
What MistralAI-User does
MistralAI-User fetches a web page when a user asks Mistral's assistant a question, so the answer can draw on the page and link to it as a source. Mistral says it doesn't crawl the web automatically and isn't used to collect training data.
- Mistral uses separate names for search indexing (MistralAI-Index) and training (MistralAI-Training), so each can be allowed or blocked on its own. Source
Does MistralAI-User follow robots.txt?
Yes. Mistral says the MistralAI-User robots.txt name governs which sites these user requests can reach.
How to block or allow MistralAI-User
Block it from the whole site:
User-agent: MistralAI-User
Disallow: /Keep it out of one folder only:
User-agent: MistralAI-User
Disallow: /private/ A crawler that finds a group with its own name follows only that group and ignores User-agent: *. If your * group disallows paths such as /admin/, repeat those lines in the MistralAI-User group. robots.txt works per host, so add the rules to each subdomain you want covered.
Test the result with the robots.txt checker, or write a new file with the robots.txt generator.
What blocking MistralAI-User changes
Mistral's assistant stops fetching and citing your pages when people ask it questions.
Where to see MistralAI-User visits
Most bots never appear in Google Analytics. Many don't run JavaScript, so the analytics tag never loads, and Google Analytics 4 automatically excludes traffic from known bots and spiders. Your server or CDN logs record every request with its user agent, so search them for the bot's name.
OneLence AI visibility shows which pages AI crawlers read and fetch for answers, next to the visitors AI assistants send you and the ones that convert.
Other bots from Mistral
- MistralAI-Index: MistralAI-Index crawls the web to build the index behind Mistral's search. Mistral says what it crawls isn't used for AI training.
- MistralAI-Training: MistralAI-Training collects public web content to train Mistral's AI models. Blocking it doesn't remove you from Mistral's search or answers.
Frequently asked questions
What is MistralAI-User?
MistralAI-User fetches a web page when a user asks Mistral's assistant a question, so the answer can draw on the page and link to it as a source. Mistral says it doesn't crawl the web automatically and isn't used to collect training data.
Does MistralAI-User follow robots.txt?
Yes. Mistral says the MistralAI-User robots.txt name governs which sites these user requests can reach.
How do I block MistralAI-User?
Add a group to robots.txt with User-agent: MistralAI-User, then Disallow: /.
What happens if I block MistralAI-User?
Mistral's assistant stops fetching and citing your pages when people ask it questions.
Why doesn't MistralAI-User show up in Google Analytics?
Most bots never appear in Google Analytics. Many don't run JavaScript, so the analytics tag never loads, and Google Analytics 4 automatically excludes traffic from known bots and spiders. Your server or CDN logs record every request with its user agent, so search them for the bot's name.
