How thx93.dev treats AI agents
thx93.dev puts a Cloudflare bot challenge in front of plain HTTP clients: robots.txt allows crawlers, no llms.txt, feed or sitemap. Agents need a real browser to fetch it.
| Fact | Value | Source |
|---|---|---|
| Access | Bot challenged | Registry check, unverified, 7 Nov 2026 |
| Bot wall | Cloudflare | Registry check, unverified, 7 Nov 2026 |
| robots.txt | Allows crawlers | Registry check, unverified, 7 Nov 2026 |
| Machine interface | None found | Registry check, unverified, 7 Nov 2026 |
| AI training (robots.txt) | No preference stated | Registry check, unverified, 7 Nov 2026 |
Listed in
Questions
Does thx93.dev block AI bots?
Yes. thx93.dev puts a Cloudflare bot challenge in front of plain HTTP clients.
Does thx93.dev have an llms.txt?
No llms.txt was found.
Does thx93.dev use a bot wall?
Yes, a Cloudflare challenge.
How should an agent fetch thx93.dev?
Agents need a real browser to fetch it.
Use this from an agent
JSON: /v1/origins/thx93.dev. MCP: https://onlinewebdirectory.net/mcp, tool lookup_origin. Setup: install notes.