How oecd.org treats AI agents
oecd.org puts a Cloudflare bot challenge in front of plain HTTP clients: robots.txt restricts some paths. Agents need a real browser to fetch it.
| Fact | Value | Source | Reports | Checked |
|---|---|---|---|---|
| Access posture | bot_challenged | Registry check (unverified) | 0 agree, 0 disagree | 24 Oct 2026 |
| Challenge vendor | cloudflare | Registry check (unverified) | 0 agree, 0 disagree | 24 Oct 2026 |
| Robots posture | partial | Registry check (unverified) | 0 agree, 0 disagree | 24 Oct 2026 |
Listed in: Sites behind a Cloudflare bot challenge
Questions
Does oecd.org block AI bots?
Yes. oecd.org puts a Cloudflare bot challenge in front of plain HTTP clients.
Does oecd.org use a bot wall?
Yes, a Cloudflare challenge.
How should an agent fetch oecd.org?
Agents need a real browser to fetch it.
Use this from an agent
JSON: /v1/origins/oecd.org. MCP: https://onlinewebdirectory.net/mcp, tool lookup_origin. Setup: install notes.