How open.cx treats AI agents
open.cx puts a Cloudflare bot challenge in front of plain HTTP clients: robots.txt restricts some paths, publishes llms.txt at /llms.txt. Agents should read /llms.txt instead of scraping.
| Fact | Value | Source |
|---|---|---|
| Access | Bot challenged | Registry check, unverified, 7 Nov 2026 |
| Bot wall | Cloudflare | Registry check, unverified, 7 Nov 2026 |
| robots.txt | Restricts some paths | Registry check, unverified, 7 Nov 2026 |
| Machine interface | llms.txt at /llms.txt | Registry check, unverified, 7 Nov 2026 |
| AI training (robots.txt) | No preference stated | Registry check, unverified, 7 Nov 2026 |
Listed in
Questions
Does open.cx block AI bots?
Yes. open.cx puts a Cloudflare bot challenge in front of plain HTTP clients.
Does open.cx have an llms.txt?
Yes, at /llms.txt.
Does open.cx use a bot wall?
Yes, a Cloudflare challenge.
How should an agent fetch open.cx?
Agents should read /llms.txt instead of scraping.
Use this from an agent
JSON: /v1/origins/open.cx. MCP: https://onlinewebdirectory.net/mcp, tool lookup_origin. Setup: install notes.