Anthropic

Claude-User

Class: User fetch
robots.txt: Says it honours robots.txt; Anthropic says disabling it stops retrieval in response to a user query.
Evidence: Confirmed from operator documentation; Source

Proving it is real

robots.txt

User-agent: Claude-User
Disallow: /

Cloudflare custom rule expression

(http.user_agent contains "Claude-User")

nginx

if ($http_user_agent ~* "Claude-User") {
    return 403;
}

Matching a name only blocks bots that tell the truth about it. Before you do this, read what each decision costs.

Last reviewed Nov 2, 2026