Search Crawler
✓ GEO Recommendation: Keep Open
ExaSearchBot
Operated by Exa · Powers Exa search & AI retrieval
ExaSearchBot crawls and indexes public web pages for Exa's search and AI retrieval applications, making content discoverable for Exa-powered search and retrieval products.
Owner
Exa
Trigger
Automated indexing
Used for AI Training
Not officially documented
robots.txt control
Yes
Impact if blocked
May prevent pages from being discovered and indexed by Exa.
How to identify
User-Agent: ExaSearchBot
What it does
ExaSearchBot crawls and indexes public web pages so they can be discovered and retrieved through Exa's search and AI retrieval applications.
Exa verifies this crawler using cryptographic HTTP Message Signatures (Web Bot Auth, RFC 9421), rather than IP-range matching alone.
Why we recommend keeping it open
- Keeps your content discoverable and indexable through Exa's search and retrieval products
- Exa documents cryptographic verification (Web Bot Auth, RFC 9421) for this crawler
- Blocking it may prevent pages from being found through Exa
Identification & robots.txt
User-Agent identifier
ExaSearchBot
Verification
Cryptographic HTTP Message Signatures (Web Bot Auth, RFC 9421).
Robots.txt guidance — Allow rule
User-agent: ExaSearchBot
Allow: /