OpenAI
OAI-SearchBot
If GPTBot and OAI-SearchBot are both allowed, OpenAI says it may use one crawl for both purposes.
- Class
- Search index
- robots.txt
- Says it honours robots.txt
- Disallowing it removes you from ChatGPT search answers, in about 24 hours.
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; +https://openai.com/searchbotProving it is real
- Check the IP against OpenAI's OAI-SearchBot file.
Blocking it
User-agent: OAI-SearchBot
Disallow: /(http.user_agent contains "OAI-SearchBot")if ($http_user_agent ~* "OAI-SearchBot") {
return 403;
}Matching a name only blocks bots that tell the truth about it. Before you do this, read what each decision costs.
Last reviewed Nov 2, 2026