Claude-User
Operated by Anthropic · Powers Claude
Claude-User fetches a web page when a person asks Claude a question that needs to look at a specific site. Anthropic lets site owners control which sites this agent can access, and states that disabling it may reduce your site's visibility for user-directed web search.
What it does
When someone asks Claude a question that requires looking at a specific website, Claude-User makes the request on their behalf. It only visits pages relevant to that one conversation — it does not crawl a site broadly or build an index.
Disabling Claude-User prevents Anthropic's system from retrieving your content in response to a user query, which Anthropic says may reduce your site's visibility for user-directed web search.
Why we recommend keeping it open
- Anthropic says blocking it may reduce your site's visibility for user-directed web search
- Not used to train Anthropic's models
- Responds to a specific person's question, not a bulk crawl
Identification & robots.txt
Claude-User
Additional verification information is available in Anthropic's official documentation.
User-agent: Claude-User
Allow: /