Anthropic

ClaudeBot

Anthropic publishes the token, not the full User-Agent string, and one IP file shared by all three of its bots.

Class: Training
robots.txt: Says it honours robots.txt; Also supports the non-standard Crawl-delay.
Evidence: Confirmed from operator documentation; Source

Proving it is real

robots.txt

User-agent: ClaudeBot
Disallow: /

Cloudflare custom rule expression

(http.user_agent contains "ClaudeBot")

nginx

if ($http_user_agent ~* "ClaudeBot") {
    return 403;
}

Matching a name only blocks bots that tell the truth about it. Before you do this, read what each decision costs.

Last reviewed Nov 2, 2026