← all bots
GPTBot
Collects public web data that may be used to train OpenAI models. Operator docs.
- Operator
- OpenAI
- Purpose
- training
- Blocked by
- 142 of 652 readable sites (21.8%) — 108 name it explicitly, 34 block it via default-deny rules
Sites blocking GPTBot
| Site | Category | How |
|---|---|---|
| 404media.co | news | named explicitly |
| academia.edu | top1k | named explicitly |
| adform.net | top1k | default-deny robots.txt |
| alibaba.com | top1k | named explicitly |
| amazon.ca | top1k | named explicitly |
| amazon.co.jp | top1k | named explicitly |
| amazon.co.uk | top1k | named explicitly |
| amazon.co.za | top1k | named explicitly |
| amazon.com | ecommerce | named explicitly |
| amazon.com.au | top1k | named explicitly |
| amazon.com.br | top1k | named explicitly |
| amazon.de | top1k | named explicitly |
| amazon.es | top1k | named explicitly |
| amazon.fr | top1k | named explicitly |
| amazon.in | top1k | named explicitly |
| amazon.it | top1k | named explicitly |
| aol.com | top1k | named explicitly |
| apnews.com | news | named explicitly |
| baidu.com | top1k | default-deny robots.txt |
| bandcamp.com | top1k | named explicitly |
| bbc.co.uk | top1k | named explicitly |
| bbc.com | news | named explicitly |
| behance.net | top1k | named explicitly |
| blackhub.team | top1k | default-deny robots.txt |
| bleacherreport.com | sports | named explicitly |
| bloomberg.com | news | named explicitly |
| canva.com | tech | named explicitly |
| cbsnews.com | news | named explicitly |
| cbssports.com | sports | named explicitly |
| chatgpt.com | top1k | default-deny robots.txt |
| claude.ai | top1k | named explicitly |
| cnbc.com | finance | named explicitly |
| cnet.com | top1k | named explicitly |
| cnn.com | news | named explicitly |
| corriere.it | top1k | named explicitly |
| creativecdn.com | top1k | default-deny robots.txt |
| crwdcntrl.net | top1k | default-deny robots.txt |
| dailymail.co.uk | news | named explicitly |
| dailymail.com | top1k | named explicitly |
| daum.net | top1k | default-deny robots.txt |
| dictionary.com | reference | named explicitly |
| ebay.co.uk | top1k | named explicitly |
| ebay.com | ecommerce | named explicitly |
| ebay.de | top1k | named explicitly |
| economist.com | news | named explicitly |
| edmunds.com | auto | named explicitly |
| espn.com | sports | named explicitly |
| fb.com | top1k | named explicitly |
| figma.com | tech | named explicitly |
| flickr.com | top1k | default-deny robots.txt |
| forbes.com | news | named explicitly |
| gamespot.com | entertainment | named explicitly |
| genius.com | reference | named explicitly |
| glassdoor.com | jobs | named explicitly |
| globalsign.com | top1k | named explicitly |
| globo.com | top1k | named explicitly |
| go.com | top1k | named explicitly |
| goodreads.com | reference | named explicitly |
| gosuslugi.ru | top1k | default-deny robots.txt |
| hbr.org | top1k | named explicitly |
| healthline.com | health | named explicitly |
| hihonorcloud.com | top1k | default-deny robots.txt |
| huffpost.com | news | named explicitly |
| ign.com | entertainment | named explicitly |
| imdb.com | reference | default-deny robots.txt |
| imgsmail.ru | top1k | default-deny robots.txt |
| instacart.com | ecommerce | default-deny robots.txt |
| instagram.com | social | named explicitly |
| kick.com | top1k | named explicitly |
| latimes.com | news | named explicitly |
| launchpad.net | top1k | named explicitly |
| lefigaro.fr | top1k | named explicitly |
| linkedin.com | social | named explicitly |
| mail.ru | top1k | default-deny robots.txt |
| mailchi.mp | top1k | default-deny robots.txt |
| medium.com | social | named explicitly |
| meraki.com | top1k | default-deny robots.txt |
| mercadolibre.com.ar | top1k | named explicitly |
| mercadolivre.com.br | top1k | named explicitly |
| metacritic.com | reference | named explicitly |
| msn.com | top1k | named explicitly |
| myfritz.net | top1k | default-deny robots.txt |
| nature.com | top1k | named explicitly |
| naver.com | top1k | default-deny robots.txt |
| nba.com | sports | named explicitly |
| nbcnews.com | news | named explicitly |
| newsweek.com | news | named explicitly |
| nexusmods.com | top1k | named explicitly |
| nikkei.com | top1k | named explicitly |
| nintendo.com | top1k | named explicitly |
| nytimes.com | news | named explicitly |
| patreon.com | top1k | named explicitly |
| pexels.com | top1k | named explicitly |
| pinimg.com | top1k | default-deny robots.txt |
| pinterest.com | social | default-deny robots.txt |
| pixabay.com | top1k | named explicitly |
| polygon.com | entertainment | named explicitly |
| quantserve.com | top1k | default-deny robots.txt |
| quora.com | reference | named explicitly |
| reddit.com | social | default-deny robots.txt |
| registrar-servers.com | top1k | default-deny robots.txt |
| repubblica.it | top1k | named explicitly |
| reuters.com | news | default-deny robots.txt |
| roblox.com | entertainment | named explicitly |
| rocketmoney.dev | top1k | default-deny robots.txt |
| semafor.com | news | named explicitly |
| sentinelone.net | top1k | default-deny robots.txt |
| sharethrough.com | top1k | named explicitly |
| snapchat.com | social | named explicitly |
| snopes.com | reference | named explicitly |
| sohu.com | top1k | default-deny robots.txt |
| soundcloud.com | entertainment | named explicitly |
| spiegel.de | top1k | named explicitly |
| statista.com | top1k | named explicitly |
| stbid.ru | top1k | default-deny robots.txt |
| t-online.de | top1k | named explicitly |
| t.co | top1k | default-deny robots.txt |
| tandfonline.com | top1k | named explicitly |
| techcrunch.com | news | named explicitly |
| ted.com | education | named explicitly |
| telegraph.co.uk | top1k | named explicitly |
| theathletic.com | sports | named explicitly |
| threads.com | social | named explicitly |
| tiktok.com | social | named explicitly |
| tiktokw.us | top1k | default-deny robots.txt |
| tripadvisor.com | travel | named explicitly |
| twitter.com | top1k | default-deny robots.txt |
| usatoday.com | news | named explicitly |
| vimeo.com | top1k | named explicitly |
| vkontakte.ru | top1k | default-deny robots.txt |
| wattpad.com | top1k | named explicitly |
| weather.com | reference | named explicitly |
| webmd.com | health | named explicitly |
| weibo.com | top1k | default-deny robots.txt |
| whatsapp.com | top1k | named explicitly |
| wikihow.com | reference | named explicitly |
| wp.pl | top1k | named explicitly |
| x.com | social | default-deny robots.txt |
| yahoo.co.jp | top1k | named explicitly |
| yahoo.com | top1k | named explicitly |
| yelp.com | food | named explicitly |
| ziprecruiter.com | jobs | named explicitly |