Home / Sites / st-andrews.ac.uk
How st-andrews.ac.uk treats AI agents
st-andrews.ac.uk is open to AI agents: no bot wall, no JavaScript needed, robots.txt restricts some paths, publishes llms.txt at /llms.txt. Agents should read /llms.txt instead of scraping.
| Fact | Value | Source |
|---|---|---|
| Access | Open | Registry check, unverified, 25 Oct 2026 |
| Bot wall | None | Registry check, unverified, 25 Oct 2026 |
| JavaScript needed | No | Registry check, unverified, 25 Oct 2026 |
| robots.txt | Restricts some paths | Registry check, unverified, 25 Oct 2026 |
| Machine interface | llms.txt at /llms.txt | Registry check, unverified, 25 Oct 2026 |
Listed in
Questions
Does st-andrews.ac.uk block AI bots?
No. st-andrews.ac.uk is open to AI agents.
Does st-andrews.ac.uk need JavaScript?
No. The page has real content without JavaScript.
Does st-andrews.ac.uk have an llms.txt?
Yes, at /llms.txt.
Does st-andrews.ac.uk use a bot wall?
No bot wall was seen.
How should an agent fetch st-andrews.ac.uk?
Agents should read /llms.txt instead of scraping.
Use this from an agent
JSON: /v1/origins/st-andrews.ac.uk. MCP: https://onlinewebdirectory.net/mcp, tool lookup_origin. Setup: install notes.