How melb.website treats AI agents
melb.website blocks plain HTTP clients: no bot wall, robots.txt allows crawlers. Agents should not fetch it.
| Fact | Value | Source |
|---|---|---|
| Access | Blocked | Registry check, unverified, 25 Oct 2026 |
| Bot wall | None | Registry check, unverified, 25 Oct 2026 |
| robots.txt | Allows crawlers | Registry check, unverified, 25 Oct 2026 |
Listed in
Questions
Does melb.website block AI bots?
Yes. melb.website blocks plain HTTP clients.
Does melb.website use a bot wall?
No bot wall was seen.
How should an agent fetch melb.website?
Agents should not fetch it.
Use this from an agent
JSON: /v1/origins/melb.website. MCP: https://onlinewebdirectory.net/mcp, tool lookup_origin. Setup: install notes.