← all bots

GrokBot

xAI/Grok crawler token, appearing in blocklists ahead of broad documentation.

Operator
xAI
Purpose
training
Blocked by
64 of 650 readable sites (9.8%) — 15 name it explicitly, 49 block it via default-deny rules

Sites blocking GrokBot

SiteCategoryHow
academia.edutop1kdefault-deny robots.txt
adform.nettop1kdefault-deny robots.txt
amazon.catop1knamed explicitly
amazon.co.jptop1knamed explicitly
amazon.co.uktop1knamed explicitly
amazon.co.zatop1knamed explicitly
amazon.comecommercenamed explicitly
amazon.com.autop1knamed explicitly
amazon.com.brtop1knamed explicitly
amazon.detop1knamed explicitly
amazon.estop1knamed explicitly
amazon.frtop1knamed explicitly
amazon.intop1knamed explicitly
amazon.ittop1knamed explicitly
amazonvideo.comtop1knamed explicitly
baidu.comtop1kdefault-deny robots.txt
blackhub.teamtop1kdefault-deny robots.txt
chatgpt.comtop1kdefault-deny robots.txt
creativecdn.comtop1kdefault-deny robots.txt
crwdcntrl.nettop1kdefault-deny robots.txt
daum.nettop1kdefault-deny robots.txt
facebook.comsocialdefault-deny robots.txt
fb.comtop1kdefault-deny robots.txt
flickr.comtop1kdefault-deny robots.txt
hihonorcloud.comtop1kdefault-deny robots.txt
imdb.comreferencedefault-deny robots.txt
imgsmail.rutop1kdefault-deny robots.txt
instacart.comecommercedefault-deny robots.txt
instagram.comsocialdefault-deny robots.txt
linkedin.comsocialdefault-deny robots.txt
linktr.eetop1kdefault-deny robots.txt
mail.rutop1kdefault-deny robots.txt
mailchi.mptop1kdefault-deny robots.txt
marketwatch.comfinancedefault-deny robots.txt
meraki.comtop1kdefault-deny robots.txt
myfritz.nettop1kdefault-deny robots.txt
naver.comtop1kdefault-deny robots.txt
netflix.comentertainmentdefault-deny robots.txt
netflix.nettop1kdefault-deny robots.txt
office365.comtop1kdefault-deny robots.txt
pinimg.comtop1kdefault-deny robots.txt
pinterest.comsocialdefault-deny robots.txt
primevideo.comtop1knamed explicitly
quantserve.comtop1kdefault-deny robots.txt
quora.comreferencedefault-deny robots.txt
reddit.comsocialdefault-deny robots.txt
registrar-servers.comtop1kdefault-deny robots.txt
reuters.comnewsdefault-deny robots.txt
sentinelone.nettop1kdefault-deny robots.txt
sharethrough.comtop1kdefault-deny robots.txt
sohu.comtop1kdefault-deny robots.txt
stbid.rutop1kdefault-deny robots.txt
t.cotop1kdefault-deny robots.txt
ted.comeducationnamed explicitly
threads.comsocialdefault-deny robots.txt
tiktokw.ustop1kdefault-deny robots.txt
trustpilot.comtop1kdefault-deny robots.txt
twitter.comtop1kdefault-deny robots.txt
vkontakte.rutop1kdefault-deny robots.txt
weibo.comtop1kdefault-deny robots.txt
wsj.comnewsdefault-deny robots.txt
x.comsocialdefault-deny robots.txt
yelp.comfooddefault-deny robots.txt
ziprecruiter.comjobsdefault-deny robots.txt