How zearn.org treats AI agents
zearn.org is open to AI agents: no bot wall, robots.txt allows crawlers, publishes a sitemap at /sitemap.xml. Agents should read /sitemap.xml instead of scraping.
| Fact | Value | Source |
|---|---|---|
| Access | Open | Registry check, unverified, 25 Oct 2026 |
| Bot wall | None | Registry check, unverified, 25 Oct 2026 |
| robots.txt | Allows crawlers | Registry check, unverified, 25 Oct 2026 |
| Machine interface | Sitemap at /sitemap.xml | Registry check, unverified, 25 Oct 2026 |
Listed in
Questions
Does zearn.org block AI bots?
No. zearn.org is open to AI agents.
Does zearn.org have an llms.txt?
No llms.txt was found.
Does zearn.org use a bot wall?
No bot wall was seen.
How should an agent fetch zearn.org?
Agents should read /sitemap.xml instead of scraping.
Use this from an agent
JSON: /v1/origins/zearn.org. MCP: https://onlinewebdirectory.net/mcp, tool lookup_origin. Setup: install notes.