Training Crawler
GEO Recommendation: Optional to Block
MistralAI-Training
Operated by Mistral AI · Collects data for model training
MistralAI-Training crawls publicly available web content that Mistral AI uses when forming datasets for training its generative AI models.
Owner
Mistral AI
Trigger
Automated crawl
Used for AI Training
Yes
robots.txt control
Yes
Impact if blocked
Prevents this crawler from accessing blocked content for AI training.
How to identify
User-Agent: MistralAI-Training
What it does
MistralAI-Training crawls publicly available web pages to collect content used when forming datasets for training Mistral's generative AI models.
It operates independently of MistralAI-Index and MistralAI-User — blocking MistralAI-Training has no effect on whether Mistral can find your pages in search functionality or fetch them for a live user request.
Why this is optional to block
- Only affects whether your content contributes to Mistral's future AI training datasets
- Has no effect on MistralAI-Index's search functionality or MistralAI-User's live fetches
- Blocking it should not be treated as a way to manage search or user-triggered access — those are governed separately
Identification & robots.txt
User-Agent identifier
MistralAI-Training
Verification
Additional verification information is available in Mistral's official documentation.
Robots.txt guidance — to opt out of training
User-agent: MistralAI-Training
Disallow: /