Diffbot
Diffbot
Token known historically. Current documentation could not be confirmed.
- Class
- Training
- robots.txt
- Not stated
- Evidence
- Unconfirmed: third-party claims only
Proving it is real
Diffbot publishes no way to confirm this identity, so any request using this name has to be taken on trust.
Blocking it
User-agent: Diffbot
Disallow: /(http.user_agent contains "Diffbot")if ($http_user_agent ~* "Diffbot") {
return 403;
}Matching a name only blocks bots that tell the truth about it. Before you do this, read what each decision costs.
Last reviewed Nov 2, 2026