Browse sites
1798 sites with enough checked facts to answer how they treat AI agents.
By category
- Sites open to AI agents
- Sites that block AI agents
- Sites behind a Cloudflare bot challenge
- Sites behind an Akamai bot challenge
- Sites behind other bot walls
- Sites that need JavaScript
- Sites that publish llms.txt
- Sites that publish a feed or sitemap
All sites
- thscore99.com
- ti.com
- tidal.com
- tiktok.com
- tiktokio.com
- time.com
- timeout.com
- timesofisrael.com
- tinyurl.com
- tjsp.jus.br
- tmall.com
- tnaflix.com
- tns-counter.ru
- today.com
- tokyomotion.net
- tomshardware.com
- tori.fi
- torob.com
- toutiao.com
- toyhou.se
- toyota.com
- tradingeconomics.com
- tradingview.com
- tradplusad.com
- traffmonetizer.com
- transip.nl
- trello.com
- tribalfusion.com
- trilltrill.jp
- tripadvisor.co.uk
- tripadvisor.com
- triplinkintl.com
- truecaller.com
- trustarc.com
- trustedstack.com
- trustindex.io
- tsyndicate.com
- tube8.fr
- tufts.edu
- tum.de
- tumblr.com
- tupi.fm
- turkiye.gov.tr
- tutu.ru
- tvmon1.com
- twingate.com
- twitch.tv
- twkan.com
- twpornstars.com
- tynt.com
- typeform.com
- typing.com
- ubc.ca
- ubuntu.com
- ucdavis.edu
- uchicago.edu
- uci.edu
- ucl.ac.uk
- ucla.edu
- ucoz.ru
- ucsb.edu
- ucsd.edu
- uefa.com
- ufl.edu
- uga.edu
- uhc.com
- ui.com
- uidai.gov.in
- uiowa.edu
- uisp.com
- uk.com
- uk.net
- ukdevilz.com
- ultimate-guitar.com
- umd.edu
- umich.edu
- un.org
- unc.edu
- undp.org
- unep.org
- unhcr.org
- unicef.org
- unisoc.com
- unity.com
- univie.ac.at
- unl.edu
- unpkg.com
- unrulymedia.com
- uol.com.br
- upenn.edu
- ups.com
- upskirt.tv
- upwork.com
- urbandictionary.com
- uribl.com
- us.com
- usa.gov
- usc.edu
- uscis.gov
- uscourts.gov
- userway.org
- usp.br
- uspto.gov
- utah.edu
- utexas.edu
- utoronto.ca
- utorrent.com
- uwaterloo.ca
- v-videoapp.com
- va.gov
- vanityfair.com
- variety.com
- varzesh3.com
- vatican.va
- venmo.com
- vercel.com
- verify.hn
- verisign.com
- verkada.com
- vg.no
- vice.com
- videeyss.shop
- videolan.org
- vidoyu.space
- vietjack.com
- vigo.tech
- vimeo.com
- virustotal.com
- vivoglobal.com
- vk.com
- vk.ru
- vkplay.ru
- vkusvill.ru
- vlr.gg
- vmware.com
- vnexpress.net
- voanews.com
- vogue.com
- vox.com
- voximplant.com
- vrbo.com
- vt.edu
- w3.org
- w3schools.com
- walgreens.com
- walkme.com
- walmart.com
- wargaming.net
- washington.edu
- watchguard.com
- wattpad.com
- wayfair.com
- wayground.com
- waze.com
- wdr.de
- weather.com
- weather.gov
- weathernews.jp
- web.de
- web.dev
- webex.com
- webflow.com
- webgo.de
- webmd.com
- webnovel.com
- websupport.sk
- wellsfargo.com
- welt.de
- wetransfer.com
- wetter.com
- wetteronline.de
- whatsapp.com
- whitehouse.gov
- who.int
- wikibooks.org
- wikidot.com
- wikimedia.org
- wikipedia.org
- wikisource.org
- wiktionary.org
- windy.com
- wipo.int
- wired.com
- wireshark.org
- wisc.edu
- wise.com
- wistia.com
- wix.com
- wnacg.com
- wonporn.com
- woocommerce.com
- wordfence.com
- wordpress.com
- wordpress.org
- wordwall.net
- worldcat.org
- wp.pl
- wpastra.com
- wpengine.com
- wpguardian.com
- wps.cn
- wps.com
- wshareit.com
- wunderground.com
- wurl.com
- www.gob.mx
- www.gov.br
- www.gov.cn
- www.gov.pl
- www.gov.uk
- www.nhs.uk
- x-cdn-static.com
- x5.ru
- xahani.com
- xero.com
- xfinity.com
- xhaccess.com
- xham.live
- xhamster.com
- xhamster.desi
- xhamster1.desi
- xhamster19.com
- xhamster2.com
- xhamster46.desi
- xhamsterlive.com
- xhlink.blog
- xhname.com
- xhopen.com
- xhplus.live
- xhsocial.com
- xhspot.com
- xhstream.com
- xhtotal.com
- xhwide.com
- xhzone.live
- xing.com
- xinhuanet.com
- xkcd.com
- xn--12c1ezaww.com
- xn--18-3qi3cza3b2a2dxc4b9a.com
- xn--42cf7cgd7gxbd4m7c.cc
- xn--l3ca4b6dsc1b.com
- xnxx-arabic.com
- xnxx.com
- xnxx.es
- xnxx.health
- xorgasmo.com
- xoso.com.vn
- xosodaiphat.com
- xpaja.net
- xsmn.mobi
- xvideo.vlog.br
- xvideos-ar.com
- xvideos.com
- xvideos.es
- xvideosbr.blog
- xxx18hot.com
- xxxbp.tv
- xxxhindi.to
- xxxpostpic.org
- xxxvideo.link
- ya.ru
- yale.edu
- yandex.by
- yandex.com
- yandex.com.tr
- yandex.kz
- ycombinator.com
- yg5sjx5kzy.com
- yimg.com
- yle.fi
- yomiuri.co.jp
- yotpo.com
- youjizz.com
- youporn.com
- youronlinechoices.com
- youronlinechoices.eu
- youtube.com
- yuga.com
- yumpu.com
- zalo.me
- zapier.com
- zbporn.tv
- zdf.de
- zdnet.com
- zearn.org
- zebawy.com
- zedge.net
- zeit.de
- zend.com
- zenodo.org
- zeotap.com
- zillow.com
- zimbra.com
- zimperium.com
- zoom.com
- zscaler.com
- zynga.com