Live instrument
Tonight's sky
What has actually visited this site, and whether it is who it says it is. Everything here is a real observation of botservatory.ai. It is not an estimate of the wider web.
- Training
- Search index
- User fetch
- Agent
- Automation
Last seven days
- Automated requests
- 121
- Verified identity
- 8
- Failed verification
- 0
- No bot markers
- 988
“No bot markers” means nothing identified the request as automated. It includes people, and it includes bots disguised as browsers. Today so far: 121 automated, 988 unmarked.
- Training6
- Search index2
- User fetch0
- Agent5
- Link preview0
- Automation108
The logbook
| When | Visitor | Class | Identity | Path |
|---|---|---|---|---|
| ClaudeBot | Training | Verified by IP list | /now | |
| ClaudeBot | Training | Verified by IP list | /about | |
| ClaudeBot | Training | Verified by IP list | /robots.txt | |
| Unlisted bot | Automation | Self-described | / | |
| OkHttp | Automation | Self-described | /favicon.png | |
| Unlisted bot | Automation | Self-described | / | |
| Unlisted bot | Automation | Self-described | / | |
| Unlisted bot | Automation | Self-described | /now | |
| Unlisted bot | Automation | Self-described | /firewall | |
| Unlisted bot | Automation | Self-described | /catalogue | |
| Unlisted bot | Automation | Self-described | /benefit | |
| https://fossick.bot | Agent | Signature presented, not checked | / | |
| ClaudeBot | Training | Verified by IP list | / | |
| ClaudeBot | Training | Verified by IP list | / | |
| ClaudeBot | Training | Verified by IP list | /robots.txt | |
| Empty User-Agent | Automation | Self-described | /.env | |
| Empty User-Agent | Automation | Self-described | /.env | |
| OAI-SearchBot | Search index | Verified by IP list | /robots.txt | |
| OAI-SearchBot | Search index | Verified by IP list | /robots.txt | |
| Unlisted bot | Automation | Self-described | / | |
| Unlisted bot | Automation | Self-described | / | |
| Unlisted bot | Automation | Self-described | / | |
| Unlisted bot | Automation | Self-described | / | |
| https://verify.stingray.security | Agent | Signature presented, not checked | / | |
| https://verify.stingray.security | Agent | Signature presented, not checked | /robots.txt | |
| OkHttp | Automation | Self-described | /favicon.png | |
| aiohttp | Automation | Self-described | / | |
| Unlisted bot | Automation | Self-described | /robots.txt | |
| curl | Automation | Self-described | /pricing | |
| Unlisted bot | Automation | Self-described | / | |
| Unlisted bot | Automation | Self-described | / | |
| curl | Automation | Self-described | / | |
| Headless Chrome | Automation | Self-described | /ephemeris | |
| Headless Chrome | Automation | Self-described | /numbers | |
| Headless Chrome | Automation | Self-described | /about | |
| Headless Chrome | Automation | Self-described | /pricing | |
| Headless Chrome | Automation | Self-described | /tools/robots | |
| Headless Chrome | Automation | Self-described | /firewall | |
| Headless Chrome | Automation | Self-described | /benefit | |
| Headless Chrome | Automation | Self-described | /tools/verify | |
| Headless Chrome | Automation | Self-described | /bot-or-not | |
| Headless Chrome | Automation | Self-described | /firewall | |
| Headless Chrome | Automation | Self-described | /benefit | |
| Headless Chrome | Automation | Self-described | /tools/verify | |
| Headless Chrome | Automation | Self-described | /catalogue | |
| Headless Chrome | Automation | Self-described | /now | |
| Headless Chrome | Automation | Self-described | /tools/robots | |
| Headless Chrome | Automation | Self-described | /bot-or-not | |
| Headless Chrome | Automation | Self-described | /catalogue | |
| Headless Chrome | Automation | Self-described | /now |
No IP addresses are stored. Requests from ordinary browsers are only counted.
The llms.txt experiment
No major operator has committed to reading llms.txt. This site publishes one anyway and counts who asks for it.
- curl /llms.txt1
Operator address files
Fetched from each operator and refreshed hourly. “Published” is the timestamp inside the file. These are what verification on this site checks against.
| Operator | File | Ranges | IPv6 | Published |
|---|---|---|---|---|
| OpenAI | GPTBot | 18 | 0 | Sep 22, 2026 |
| OpenAI | OAI-SearchBot | 39 | 0 | Jan 2, 2026 |
| OpenAI | ChatGPT-User | 235 | 0 | Oct 27, 2026 |
| OpenAI | OAI-AdsBot | 2 | 0 | May 12, 2026 |
| Anthropic | All Claude crawlers | 14 | 0 | Oct 20, 2026 |
| Common crawlers | 317 | 147 | Nov 2, 2026 | |
| User-triggered agents | 20 | 8 | Nov 2, 2026 | |
| User-triggered fetchers | 1,068 | 534 | Nov 2, 2026 | |
| Fetchers on Google ranges | 504 | 252 | Nov 2, 2026 | |
| Microsoft | bingbot | 28 | 0 | Jan 3, 2024 |
| Perplexity | PerplexityBot | 13 | 0 | Oct 28, 2026 |
| Perplexity | Perplexity-User | 10 | 0 | Oct 28, 2026 |
| Apple | Applebot | 24 | 0 | Sep 15, 2026 |
| Common Crawl | CCBot | 5 | 1 | Aug 11, 2026 |
| DuckDuckGo | DuckAssistBot | 486 | 0 | Sep 1, 2026 |
| Mistral | MistralAI-User | 4 | 0 | Feb 19, 2025 |