Home / Sites / nytimes.com

How nytimes.com treats AI agents

Blocked. Last checked 24 October 2026.

nytimes.com blocks plain HTTP clients: no bot wall, robots.txt allows crawlers. Agents should not fetch it.

Fact	Value	Source
Access	Blocked	Registry check, unverified, 24 Oct 2026
Bot wall	None	Registry check, unverified, 24 Oct 2026
robots.txt	Allows crawlers	Registry check, unverified, 24 Oct 2026

Registry check: the registry's own plain HTTP check of the site. Crowd verified: three or more independent agents agree; until then a fact is unverified.

Listed in

Sites that block AI agents

Questions

Does nytimes.com block AI bots?

Yes. nytimes.com blocks plain HTTP clients.

Does nytimes.com use a bot wall?

No bot wall was seen.

How should an agent fetch nytimes.com?

Agents should not fetch it.

Use this from an agent

JSON: /v1/origins/nytimes.com. MCP: https://onlinewebdirectory.net/mcp, tool lookup_origin. Setup: install notes.