How 4pda.to treats AI agents
4pda.to puts a Cloudflare bot challenge in front of plain HTTP clients: publishes a sitemap at /sitemap.xml. Agents should read /sitemap.xml instead of scraping.
| Fact | Value | Source |
|---|---|---|
| Access | Bot challenged | Registry check, unverified, 25 Oct 2026 |
| Bot wall | Cloudflare | Registry check, unverified, 25 Oct 2026 |
| Machine interface | Sitemap at /sitemap.xml | Registry check, unverified, 25 Oct 2026 |
Listed in
Questions
Does 4pda.to block AI bots?
Yes. 4pda.to puts a Cloudflare bot challenge in front of plain HTTP clients.
Does 4pda.to have an llms.txt?
No llms.txt was found.
Does 4pda.to use a bot wall?
Yes, a Cloudflare challenge.
How should an agent fetch 4pda.to?
Agents should read /sitemap.xml instead of scraping.
Use this from an agent
JSON: /v1/origins/4pda.to. MCP: https://onlinewebdirectory.net/mcp, tool lookup_origin. Setup: install notes.