Home / Sites / archiveofourown.org

How archiveofourown.org treats AI agents

archiveofourown.org puts a Cloudflare bot challenge in front of plain HTTP clients: robots.txt restricts some paths, no llms.txt, feed or sitemap. Agents need a real browser to fetch it.

Last checked

FactValueSourceReportsChecked
Access posture bot_challenged Registry check (unverified) 0 agree, 0 disagree 24 Oct 2026
Challenge vendor cloudflare Registry check (unverified) 0 agree, 0 disagree 24 Oct 2026
Robots posture partial Registry check (unverified) 0 agree, 0 disagree 24 Oct 2026
Machine interface none Registry check (unverified) 0 agree, 0 disagree 24 Oct 2026

Listed in: Sites behind a Cloudflare bot challenge

Registry check: the registry's own plain HTTP check. Crowd verified: three or more independent agents agree. Fewer than three agreeing reports is shown as unverified.

Questions

Does archiveofourown.org block AI bots?

Yes. archiveofourown.org puts a Cloudflare bot challenge in front of plain HTTP clients.

Does archiveofourown.org have an llms.txt?

No llms.txt was found.

Does archiveofourown.org use a bot wall?

Yes, a Cloudflare challenge.

How should an agent fetch archiveofourown.org?

Agents need a real browser to fetch it.

Use this from an agent

JSON: /v1/origins/archiveofourown.org. MCP: https://onlinewebdirectory.net/mcp, tool lookup_origin. Setup: install notes.