← all bots

anthropic-ai

Legacy Anthropic control token; many sites still block it alongside ClaudeBot. Operator docs.

Operator
Anthropic
Purpose
training
Blocked by
116 of 650 readable sites (17.8%) — 69 name it explicitly, 47 block it via default-deny rules

Sites blocking anthropic-ai

SiteCategoryHow
academia.edutop1kdefault-deny robots.txt
adform.nettop1kdefault-deny robots.txt
allrecipes.comfoodnamed explicitly
aol.comtop1knamed explicitly
apnews.comnewsnamed explicitly
arstechnica.comnewsnamed explicitly
baidu.comtop1kdefault-deny robots.txt
bbc.co.uktop1knamed explicitly
bbc.comnewsnamed explicitly
behance.nettop1knamed explicitly
blackhub.teamtop1kdefault-deny robots.txt
bleacherreport.comsportsnamed explicitly
bloomberg.comnewsnamed explicitly
businessinsider.comnewsnamed explicitly
canva.comtechnamed explicitly
chatgpt.comtop1knamed explicitly
cnbc.comfinancenamed explicitly
cnet.comtop1knamed explicitly
cnn.comnewsnamed explicitly
corriere.ittop1knamed explicitly
creativecdn.comtop1kdefault-deny robots.txt
crwdcntrl.nettop1kdefault-deny robots.txt
dailymail.co.uknewsnamed explicitly
dailymail.comtop1knamed explicitly
daum.nettop1kdefault-deny robots.txt
disneyplus.comentertainmentdefault-deny robots.txt
ebay.co.uktop1knamed explicitly
ebay.comecommercenamed explicitly
ebay.detop1knamed explicitly
economist.comnewsnamed explicitly
espn.comsportsnamed explicitly
facebook.comsocialdefault-deny robots.txt
fb.comtop1kdefault-deny robots.txt
flickr.comtop1kdefault-deny robots.txt
forbes.comnewsnamed explicitly
ft.comnewsnamed explicitly
glassdoor.comjobsnamed explicitly
healthline.comhealthnamed explicitly
hihonorcloud.comtop1kdefault-deny robots.txt
huffpost.comnewsnamed explicitly
hulu.comentertainmentdefault-deny robots.txt
ign.comentertainmentnamed explicitly
imdb.comreferencedefault-deny robots.txt
imgsmail.rutop1kdefault-deny robots.txt
instacart.comecommercedefault-deny robots.txt
instagram.comsocialdefault-deny robots.txt
investopedia.comreferencenamed explicitly
lefigaro.frtop1knamed explicitly
lemonde.frtop1knamed explicitly
linkedin.comsocialnamed explicitly
linktr.eetop1kdefault-deny robots.txt
mail.rutop1kdefault-deny robots.txt
mailchi.mptop1kdefault-deny robots.txt
marketwatch.comfinancedefault-deny robots.txt
meraki.comtop1kdefault-deny robots.txt
msn.comtop1knamed explicitly
myfritz.nettop1kdefault-deny robots.txt
nature.comtop1knamed explicitly
naver.comtop1kdefault-deny robots.txt
nba.comsportsnamed explicitly
nbcnews.comnewsnamed explicitly
netflix.comentertainmentdefault-deny robots.txt
netflix.nettop1kdefault-deny robots.txt
newsweek.comnewsnamed explicitly
nikkei.comtop1knamed explicitly
nypost.comnewsnamed explicitly
nytimes.comnewsnamed explicitly
office365.comtop1kdefault-deny robots.txt
people.comtop1knamed explicitly
pinimg.comtop1kdefault-deny robots.txt
pinterest.comsocialdefault-deny robots.txt
polygon.comentertainmentnamed explicitly
quantserve.comtop1kdefault-deny robots.txt
quora.comreferencedefault-deny robots.txt
reddit.comsocialdefault-deny robots.txt
registrar-servers.comtop1kdefault-deny robots.txt
repubblica.ittop1knamed explicitly
reuters.comnewsdefault-deny robots.txt
sentinelone.nettop1kdefault-deny robots.txt
seriouseats.comfoodnamed explicitly
sharethrough.comtop1kdefault-deny robots.txt
snapchat.comsocialnamed explicitly
snopes.comreferencenamed explicitly
sohu.comtop1kdefault-deny robots.txt
soundcloud.comentertainmentnamed explicitly
spiegel.detop1knamed explicitly
statista.comtop1knamed explicitly
stbid.rutop1kdefault-deny robots.txt
t.cotop1kdefault-deny robots.txt
techcrunch.comnewsnamed explicitly
ted.comeducationnamed explicitly
telegraph.co.uktop1knamed explicitly
theathletic.comsportsnamed explicitly
theatlantic.comnewsnamed explicitly
theguardian.comnewsnamed explicitly
theverge.comnewsnamed explicitly
threads.comsocialdefault-deny robots.txt
tiktok.comsocialnamed explicitly
tiktokw.ustop1kdefault-deny robots.txt
trustpilot.comtop1knamed explicitly
tumblr.comsocialnamed explicitly
twitter.comtop1kdefault-deny robots.txt
uol.com.brtop1knamed explicitly
usatoday.comnewsnamed explicitly
vimeo.comtop1knamed explicitly
vkontakte.rutop1kdefault-deny robots.txt
vox.comnewsnamed explicitly
washingtonpost.comnewsnamed explicitly
weather.comreferencenamed explicitly
weibo.comtop1kdefault-deny robots.txt
wikihow.comreferencenamed explicitly
wsj.comnewsdefault-deny robots.txt
x.comsocialdefault-deny robots.txt
yahoo.comtop1knamed explicitly
yelp.comfoodnamed explicitly
ziprecruiter.comjobsdefault-deny robots.txt