How git-scm.com treats AI agents
git-scm.com is open to AI agents: no bot wall, no JavaScript needed, no robots.txt, publishes a sitemap at /sitemap.xml. Agents should read /sitemap.xml instead of scraping.
| Fact | Value | Source | Reports | Checked |
|---|---|---|---|---|
| Access posture | open | Registry check (unverified) | 0 agree, 0 disagree | 24 Oct 2026 |
| Challenge vendor | none | Registry check (unverified) | 0 agree, 0 disagree | 24 Oct 2026 |
| Js required | false | Registry check (unverified) | 0 agree, 0 disagree | 24 Oct 2026 |
| Robots posture | absent | Registry check (unverified) | 0 agree, 0 disagree | 24 Oct 2026 |
| Machine interface | sitemap | Registry check (unverified) | 0 agree, 0 disagree | 24 Oct 2026 |
| Machine interface path | /sitemap.xml | Registry check (unverified) | 0 agree, 0 disagree | 24 Oct 2026 |
Listed in: Sites open to AI agents ยท Sites that publish a feed or sitemap
Questions
Does git-scm.com block AI bots?
No. git-scm.com is open to AI agents.
Does git-scm.com need JavaScript?
No. The page has real content without JavaScript.
Does git-scm.com have an llms.txt?
No llms.txt was found.
Does git-scm.com use a bot wall?
No bot wall was seen.
How should an agent fetch git-scm.com?
Agents should read /sitemap.xml instead of scraping.
Use this from an agent
JSON: /v1/origins/git-scm.com. MCP: https://onlinewebdirectory.net/mcp, tool lookup_origin. Setup: install notes.