Search Crawler
✓ GEO Recommendation: Keep Open
MistralAI-Index
Operated by Mistral AI · Powers Mistral search functionality
MistralAI-Index is Mistral's automated crawler for indexing publicly available web content, used to power search-related functionality in Mistral's products. It is not used to train Mistral's generative AI models.
Owner
Mistral AI
Trigger
Automated crawl / indexing
Used for AI Training
No
robots.txt control
Yes
Impact if blocked
Can reduce the chance your pages are found and referenced by Mistral's search functionality
How to identify
User-Agent: MistralAI-Index
What it does
MistralAI-Index crawls publicly available web pages to build the index behind Mistral's search-related functionality, helping Mistral's products discover and reference relevant content.
It is separate from MistralAI-Training, Mistral's crawler for AI training data, and from MistralAI-User, which fetches individual pages on demand for a specific user request.
Why we recommend keeping it open
- Keeps your content discoverable within Mistral's search functionality
- Not used to train Mistral's generative AI models
- Independent of MistralAI-Training — blocking one does not affect the other
Identification & robots.txt
User-Agent identifier
MistralAI-Index
Verification
Additional verification information is available in Mistral's official documentation.
Robots.txt guidance — Allow rule
User-agent: MistralAI-Index
Allow: /