Browse sites
1708 sites with enough checked facts to answer how they treat AI agents.
By category
- Sites open to AI agents
- Sites that block AI agents
- Sites behind a Cloudflare bot challenge
- Sites behind an Akamai bot challenge
- Sites behind other bot walls
- Sites that need JavaScript
- Sites that publish llms.txt
- Sites that publish a feed or sitemap
All sites
- 163.com
- 1688.com
- 18comic.vip
- 1c.ru
- 1mg.com
- 1password.com
- 24h.com.vn
- 2gis.ru
- 33apk.com
- 360.cn
- 3bmeteo.com
- 3hentai.net
- 3lift.com
- 500px.com
- 7hyy.com
- a-mo.net
- aa.com
- aajtak.in
- aarp.org
- abc.es
- abc.net.au
- abcnews.com
- abebooks.com
- about.me
- aboutcookies.org
- abovedomains.com
- absher.sa
- acesso.gov.br
- acm.org
- acorns.com
- acs.org
- action.com
- actu.fr
- ad-contents.jp
- ad-delivery.net
- adblockplus.org
- addtoany.com
- adentifi.com
- adguard.com
- adkernel.com
- admanmedia.com
- admatic.de
- administracionelectronica.gob.es
- adobe.com
- adp.com
- adroll.com
- adsafeprotected.com
- adsrvr.org
- adswizz.com
- adtarget.com.tr
- adtelligent.com
- affirm.com
- afribaba.com
- afternic.com
- aftonbladet.se
- agoda.com
- ahacdn.me
- ahrefs.com
- airbnb.com
- airtable.com
- akismet.com
- albumaty.com
- alchemer.com
- alibaba.com
- alidns.com
- alipay.com
- aljazeera.com
- allaboutcookies.org
- allegro.pl
- allrecipes.com
- alphapolis.co.jp
- alphonso.tv
- alura.com.br
- amazon.ae
- amazon.ca
- amazon.co.jp
- amazon.co.uk
- amazon.co.za
- amazon.com
- amazon.com.au
- amazon.com.br
- amazon.com.mx
- amazon.de
- amazon.eg
- amazon.es
- amazon.fr
- amazon.in
- amazon.it
- amazon.nl
- ameblo.jp
- amocrm.ru
- amplitude.com
- amxrtb.com
- an1.com
- android.com
- animanch.com
- aniview.com
- annunci69.it
- ansa.it
- antarvasna3.com
- anthropic.com
- anybunny.org
- aol.com
- apa.org
- apache.org
- apachefriends.org
- apkpure.com
- apnews.com
- appcenter.ms
- apple.com
- apple.news
- applovin.com
- apptracer.ru
- arabx.cam
- arabxn.sex
- arbada.com
- arbeitsagentur.de
- archdaily.com
- archive.is
- archive.org
- archive.ph
- archiveofourown.org
- archives.gov
- archlinux.org
- ardmediathek.de
- arduino.cc
- arionplay.com
- arizona.edu
- arstechnica.com
- artstation.com
- arxiv.org
- as.com
- asahi.com
- asana.com
- astrumu.io
- asu.edu
- asurascans.com
- asus.com
- aternos.org
- atlassian.com
- atom.com
- au.com
- aucey.com
- auone.jp
- auth0.com
- automattic.com
- autoplius.lt
- autotrader.co.uk
- auvik.com
- av19t.com
- av380.net
- aviasales.com
- avito.ru
- axios.com
- ay.delivery
- ay267.com
- az24.vn
- aznude.com
- backblaze.com
- badoo.com
- bahn.de
- bakusai.com
- bale.ai
- banahosting.com
- bandcamp.com
- bankofamerica.com
- barnesandnoble.com
- bayern.de
- bazaarvoice.com
- bbc.co.uk
- bbc.com
- bblaa.com
- beboo.ru
- beeg.porn
- beget.com
- behance.net
- bentley.com
- berkeley.edu
- betika.com
- betking.com
- betpawa.cm
- betpawa.co.tz
- betpawa.com
- betpawa.ug
- betway.co.bw
- betway.co.za
- bfmtv.com
- bfvideo.site
- bhojpurisex.site
- biblegateway.com
- bidease.com
- bigcartel.com
- bigo.sg
- bigolive.tv
- bikewale.com
- bild.de
- bilibili.tv
- billboard.com
- binance.com
- bing.com
- bitbucket.org
- bitly.com
- bitnami.com
- bitrix24.ru
- blacktoon418.com
- blic.rs
- blismedia.com
- blog.google
- blooket.com
- bloomberg.com
- bls.gov
- bmj.com
- bmw-motorrad.com.cn
- booking.com
- bookmark.xxx
- bootstrapcdn.com
- boston.com
- botinok.porn
- box.com
- bpexch.live
- branch.io
- brandbucket.com
- brave.com
- braze.com
- brevo.com
- brightcove.com
- britannica.com
- broadcom.com
- brookings.edu
- brown.edu
- bsgslb.com
- bsky.app
- bt.com
- bt.dk
- bttrack.com
- bu.edu
- bugsnag.com
- bumble.com
- businessinsider.com
- buzzfeed.com
- buzzsprout.com
- bytedance.com
- c6gj-static.net
- ca.gov
- cadent.com
- cafe24.com
- calameo.com
- calculator.net
- calendly.com
- caliente.mx
- callrail.com
- cam.ac.uk
- cambridge.org
- canada.ca
- cancer.gov
- cancer.org
- caniuse.com
- canonical.com
- canva.com
- capcut.com
- capitalone.com
- cardekho.com
- cardgames.io
- carsensor.net
- cbl.gov.ly
- cbsnews.com
- cbssports.com
- ccc.de
- cctv.com
- cdiscount.com
- cell.com
- celtra.com
- census.gov
- centos.org
- change.org
- character.ai
- chartbeat.com
- chase.com
- chatgpt.com
- check24.de
- checkpoint.com
- chess.com
- chinadaily.com.cn
- choiceadvantage.com
- chordtela.com
- chosun.com
- chron.com
- cisa.gov
- citi.com
- citrix.com
- clarin.com
- classlink.com
- claude.ai
- claude.com
- clever.com
- clickagy.com
- clickup.com
- clinicaltrials.gov
- cloud.com
- cloud.microsoft
- cloudflareinsights.com
- cloudinary.com
- cloudns.net
- cmu.edu
- cnet.com
- cnil.fr
- cnnbrasil.com.br
- code.org
- codeberg.org
- coinbase.com
- coindesk.com
- coingecko.com
- coinmarketcap.com
- collegeboard.org
- colliderporn.com
- colorado.edu
- colorlib.com
- columbia.edu
- congress.gov
- constantcontact.com
- consultant.ru
- consumerreports.org
- contextweb.com
- cookiebot.com
- cookieyes.com
- cookpad.com
- copper6.com
- cornell.edu
- corriere.it
- cosmopolitan.com
- costco.com
- coupang.com
- coursera.org
- cpan.org
- cpanel.net
- cpi.ad.jp
- crazyegg.com
- crazygames.com
- crealitycloud.com
- creativecommons.org
- crn77.com
- cronista.com
- croxyproxy.com
- crpt.ru
- crunchbase.com
- crunchyroll.com
- ctvnews.ca
- curl.se
- cursor.com
- customer.io
- cutt.ly
- cve.org
- cvent.com
- cygwin.com
- dagbladet.no
- dailymotion.com
- dalyfeds.com
- dantri.com.vn
- darkero.com
- databricks.com
- datadoghq.com
- dataprivacyframework.gov
- datto.com
- daum.net
- dcinside.com
- ddnss.de
- de.com
- deadline.com
- debian.org
- deepintent.com
- deepseek.com
- deere.com
- delta.com
- demandbase.com
- desikahani2.net
- desitales2.com
- desitelugusex.com
- dev.to
- deviantart.com
- devil69porn.tv
- dhs.gov
- dictionary.com
- didiglobal.com
- digg.com
- digikala.com
- digilocker.gov.in
- digitallocker.gov.in
- digitalocean.com
- digitaltrends.com
- dinahosting.com
- dingtalk.com
- directnic.com
- discord.com
- dish.com
- disney.com
- disqus.com
- dmac-solutions.net
- dns-shop.ru
- dns.google
- dnsimple.com
- dnsmadeeasy.com
- dnspod.com
- docker.com
- docusign.com
- dogdrip.net
- doi.org
- dol.gov
- domaindetails.com
- domaintools.com
- doordash.com
- douban.com
- doubleverify.com
- douyin.com
- dpbossss.boston
- dreamhost.com
- dribbble.com
- drom.ru
- dropbox.com
- dropcatch.com
- drpc.org
- drupal.org
- drweb.com
- duckdns.org
- duckduckgo.com
- duke.edu
- duolingo.com
- dvr163.com
- dw.com
- dynatrace.com
- e-hentai.org
- e-recht24.de
- e-volution.ai
- e621.net
- ea.com
- earthlink.net
- easybrain.com
- easydns.com
- easytrader.ir
- ebay.co.uk
- ebay.com
- ebay.de
- ebay.it
- ebsco.com
- ecnavi.jp
- economist.com
- ecosia.org
- edmentum.com
- educationportal3.in
- edx.org
- eenadu.net
- eff.org
- egnyte.com
- ekstrabladet.dk
- elastic.co
- elconfidencial.com
- elegantthemes.com
- elementor.com
- elevenlabs.io
- elle.com
- elmundo.es
- elpais.com
- elsevier.com
- eltiempo.es
- emaktab.uz
- enable-javascript.com
- endpoints.news
- energy.gov
- engadget.com
- entrepreneur.com
- envato.com
- epa.gov
- eporner.com
- erome.com
- esa.int
- escort.club
- eskimi.com
- espn.com
- espn.com.ve
- esquire.com
- ethz.ch
- etsy.com
- eu.com
- eurodns.com
- euronews.com
- europa.eu
- eventbrite.co.uk
- eventbrite.com
- evernote.com
- ex.co
- example.com
- example.org
- expedia.com
- expireddomains.com
- express.co.uk
- expressen.se
- ey43.com
- eye4.cn
- f5.com
- f95zone.to
- fabguys.com