Browse sites
1706 sites with enough checked facts to answer how they treat AI agents.
By category
- Sites open to AI agents
- Sites that block AI agents
- Sites behind a Cloudflare bot challenge
- Sites behind an Akamai bot challenge
- Sites behind other bot walls
- Sites that need JavaScript
- Sites that publish llms.txt
- Sites that publish a feed or sitemap
All sites
- ninisite.com
- nip.io
- nist.gov
- njavtv.com
- nlnetlabs.nl
- noaa.gov
- nobelprize.org
- nodejs.org
- noodlemagazine.com
- nordvpn.com
- northwestern.edu
- nos.nl
- note.com
- notion.com
- nsone.net
- nsw.gov.au
- ntp.br
- nubank.com.br
- nustargame.com
- ny.gov
- nya2.com
- nymag.com
- nypost.com
- nytimes.com
- nzherald.co.nz
- odoo.com
- oecd.org
- ohmy.bid
- ojogodobicho.com
- ok.ru
- okdiario.com
- okta.com
- olx.com.br
- olx.pl
- olx.ua
- omg10.com
- omni-dex.io
- onaudience.com
- onesignal.com
- onet.pl
- onetag-sys.com
- onetrust.com
- openai.com
- openldap.org
- opensource.org
- openstreetmap.org
- opensuse.org
- opera.com
- operacdn.com
- oppomobile.com
- optable.co
- optimizely.com
- optimove.net
- orcid.org
- oregonstate.edu
- oreilly.com
- orf.at
- oricon.co.jp
- osano.com
- osha.gov
- osym.gov.tr
- otomoto.pl
- otto.de
- oup.com
- ouraring.com
- ourworldindata.org
- outbrain.com
- overwolf.com
- ovh.net
- ovhcloud.com
- owasp.org
- oxylabs.io
- packzy.com
- padlet.com
- pagibigfundservices.com
- palmplaystore.com
- paloaltonetworks.com
- pandasecurity.com
- parallels.com
- parivahan.gov.in
- parklogic.com
- pastebin.com
- patreon.com
- paywb.com
- pbs.org
- pccc.com
- pchome.com.tw
- pendo.io
- people.com
- people.com.cn
- perl.org
- perplexity.ai
- pewresearch.org
- pexels.com
- photobucket.com
- php.net
- phys.org
- piano.io
- piccoma.com
- pikabu.ru
- pimpbunny.com
- pinduoduo.com
- pixabay.com
- pki.goog
- pla3.com
- playhop.com
- playinboss.com
- playrix.com
- plesk.com
- plex.tv
- plos.org
- pluto.tv
- pnas.org
- podbean.com
- poki.com
- politico.eu
- polybuzz.ai
- polymarket.com
- porkbun.com
- porn300.com
- pornhat.com
- pornhat.one
- pornhub.com
- pornoborshch.com
- pornone.com
- pornpics.com
- poste.it
- postgresql.org
- posthog.com
- postman.com
- powerbi.com
- ppomppu.co.kr
- prezi.com
- primis.tech
- prnewswire.com
- profi.ru
- programme-tv.net
- promiedos.com.ar
- property24.com
- proton.me
- protothema.gr
- prtimes.jp
- pruffme.com
- ps.kz
- psu.edu
- publi24.ro
- publicnode.com
- purdue.edu
- pusher.com
- pushwoosh.com
- pussyboy.net
- pussyspace.com
- pypi.org
- python.org
- qq.com
- qualcomm.com
- qualtrics.com
- quantummetric.com
- quark.cn
- quickconnect.to
- quizlet.com
- quora.com
- qz.com
- rackspace.com
- raiffeisen.ru
- rainberrytv.com
- rakuten-sec.co.jp
- rambler.ru
- rapid7.com
- rat.xxx
- razorpay.com
- redbubble.com
- redhat.com
- redis.io
- redtube.com
- reg.ru
- register.it
- registry.in
- remove.bg
- replit.com
- repubblica.it
- researchgate.net
- revcontent.com
- revenuecat.com
- rexporn.sex
- rfc-editor.org
- ria.ru
- richaudience.com
- rightmove.co.uk
- ringcentral.com
- ripe.net
- riskified.com
- rkdms.com
- roblox.com
- rochester.edu
- rockstargames.com
- roku.com
- rollingstone.com
- romarg.com
- rome2rio.com
- rottentomatoes.com
- rsc.org
- rspamd.com
- rtbwise.com
- rtve.es
- rudderstack.com
- rule34.xxx
- ruliweb.com
- rumble.com
- rustdesk.com
- rutgers.edu
- rutube.ru
- saby.ru
- safety.google
- sagepub.com
- salon.com
- salthasher.com
- samba.tv
- sambad.com
- samplicio.us
- samsclub.com
- samsungcloud.com
- samsunghealth.com
- sapo.pt
- sardine.ai
- sarkariresult.com.cm
- satta-king-fast.com
- sattamatka.email
- sattamatkano1.me
- savefrom.net
- sba.gov
- sbb.ch
- sber.ru
- scan-manga.com
- schneevonmorgen.com
- schwab.com
- science.org
- sciencedaily.com
- scientificamerican.com
- scmp.com
- screenconnect.com
- screener.in
- scribd.com
- scryfall.com
- sec.gov
- sectigo.com
- securityfocus.com
- seedtag.com
- seek.com
- selectel.ru
- semanticscholar.org
- semrush.com
- sendbird.com
- sensic.net
- serverdata.net
- service.gov.uk
- sex-studentki.team
- sexalarab.com
- sexlog.com
- sexmupxinh.net
- sexnyk.com
- sexvid.xxx
- sexvid1.com
- sexybluefilm.com
- sfgate.com
- sfr.fr
- share.google
- sharethis.com
- shazam.com
- shodan.io
- shopee.co.id
- shopee.com.br
- shopee.ph
- shopee.vn
- shopify.com
- shopifycloud.com
- shopsy.in
- shorturl.at
- shutterstock.com
- si.com
- si.edu
- signal.org
- simpli.fi
- simplisafe.com
- sina.com.cn
- sinaimg.cn
- singular.net
- sinoptik.ua
- siriusxm.com
- site.com
- skelbiu.lt
- sketchfab.com
- skipthegames.com
- skroutz.gr
- sky.com
- skysports.com
- slack.com
- slashdot.org
- slate.com
- smadex.com
- smartsheet.com
- smh.com.au
- smi2.net
- smilewanted.com
- smithsonianmag.com
- snapchat.com
- snapcraft.io
- snaptik.app
- so.com
- sondakika.com
- sonobi.com
- sotwe.com
- soundcloud.com
- sourceforge.net
- sozcu.com.tr
- spaggiari.eu
- spamhaus.org
- spankbang.com
- sparteo.com
- speedtest.net
- spiegel.de
- splashtop.com
- split.io
- sport24.gr
- sportradar.com
- sprinthost.ru
- sproutsocial.com
- squarespace.com
- squareup.com
- ss.com
- ssl.com
- ssstik.io
- stackadapt.com
- stackexchange.com
- stanford.edu
- starbucks.com
- starlink.com
- staseraintv.com
- statcounter.com
- statista.com
- steamcommunity.com
- steampowered.com
- strato.de
- strava.com
- stripchat.com
- stripe.com
- stumbleupon.com
- su89-cdn.net
- substack.com
- sueddeutsche.de
- sundaysky.com
- suno.com
- supercell.com
- superhosting.bg
- superporn.com
- surfshark.com
- surveymonkey.com
- suumo.jp
- sweb.ru
- swishapps.ai
- sxyprn.com
- syosetu.com
- t-online.de
- tabelog.com
- taboola.com
- tabor.ru
- tagesschau.de
- tagesspiegel.de
- tailscale.com
- takeaway.com
- taktube.net
- tamildhool.tech
- tamilsexvids.net
- tamilsexzone.com
- tamu.edu
- tandfonline.com
- taobao.com
- tapad.com
- target.com
- tawk.to
- tcgplayer.com
- teacherspayteachers.com
- teads.tv
- techcrunch.com
- techtarget.com
- teepublic.com
- telefonica.de
- telegra.ph
- telegram.org
- telegraph.co.uk
- telogis.com
- temu.com
- tenable.com
- tenki.jp
- tenor.com
- terra.com.br
- testbook.com
- texas.gov
- tgju.org
- thawte.com
- theatlantic.com
- theblowers.com
- theconversation.com
- thedailybeast.com
- thefreedictionary.com
- theglobeandmail.com
- thehill.com
- thehindu.com
- thelancet.com
- themeforest.net
- themoviedb.org
- thenai.org
- thenkiri.com
- theqoo.net
- therapservices.net
- thetimes.com
- theverge.com
- theyarehuge.com
- thingiverse.com
- thisvid.com
- threatlocker.com
- thscore99.com
- ti.com
- tidal.com
- tiktok.com
- tiktokio.com
- time.com
- timeout.com
- tinyurl.com
- tjsp.jus.br
- tmall.com
- tnaflix.com
- tns-counter.ru
- today.com
- tokyomotion.net
- tomshardware.com
- tori.fi
- torob.com
- toutiao.com
- toyhou.se
- toyota.com
- tradingeconomics.com
- tradingview.com
- tradplusad.com
- traffmonetizer.com
- transip.nl
- trello.com
- tribalfusion.com
- trilltrill.jp
- tripadvisor.co.uk
- tripadvisor.com
- triplinkintl.com
- truecaller.com
- trustarc.com
- trustedstack.com
- trustindex.io
- tsyndicate.com
- tube8.fr
- tufts.edu
- tumblr.com
- tupi.fm
- turkiye.gov.tr
- tutu.ru
- tvmon1.com
- twingate.com
- twitch.tv
- twkan.com
- twpornstars.com
- tynt.com
- typeform.com
- typing.com
- ubc.ca
- ubuntu.com
- ucdavis.edu
- uchicago.edu
- uci.edu
- ucl.ac.uk
- ucla.edu
- ucoz.ru
- ucsb.edu
- ucsd.edu
- uefa.com
- ufl.edu
- uga.edu
- uhc.com
- ui.com
- uidai.gov.in
- uisp.com
- uk.com
- uk.net
- ukdevilz.com
- ultimate-guitar.com
- umd.edu
- umich.edu
- un.org
- unc.edu
- undp.org
- unep.org
- unicef.org
- unisoc.com