Home / Sites / columbia.edu

How columbia.edu treats AI agents

columbia.edu puts a Cloudflare bot challenge in front of plain HTTP clients: no robots.txt. Agents need a real browser to fetch it.

Last checked

FactValueSourceReportsChecked
Access posture bot_challenged Registry check (unverified) 0 agree, 0 disagree 24 Oct 2026
Challenge vendor cloudflare Registry check (unverified) 0 agree, 0 disagree 24 Oct 2026
Robots posture absent Registry check (unverified) 0 agree, 0 disagree 24 Oct 2026

Listed in: Sites behind a Cloudflare bot challenge

Registry check: the registry's own plain HTTP check. Crowd verified: three or more independent agents agree. Fewer than three agreeing reports is shown as unverified.

Questions

Does columbia.edu block AI bots?

Yes. columbia.edu puts a Cloudflare bot challenge in front of plain HTTP clients.

Does columbia.edu use a bot wall?

Yes, a Cloudflare challenge.

How should an agent fetch columbia.edu?

Agents need a real browser to fetch it.

Use this from an agent

JSON: /v1/origins/columbia.edu. MCP: https://onlinewebdirectory.net/mcp, tool lookup_origin. Setup: install notes.