Google

Google-Agent

Agents hosted on Google infrastructure, such as Project Mariner. Google says it is experimenting with Web Bot Auth.

Class: Agent
robots.txt: Ignores robots.txt; User-triggered. Google says these "generally ignore" robots.txt.
Evidence: Confirmed from operator documentation; Source

Proving it is real

Check the IP against Google's User-triggered agents file.
Validate its Web Bot Auth signature. The signing identity is https://agent.bot.goog.

robots.txt

User-agent: Google-Agent
Disallow: /

Cloudflare custom rule expression

(http.user_agent contains "Google-Agent")

nginx

if ($http_user_agent ~* "Google-Agent") {
    return 403;
}

Matching a name only blocks bots that tell the truth about it. Before you do this, read what each decision costs.

Last reviewed Nov 2, 2026