← all sites

E-commerce sites vs AI crawlers

22 tracked e-commerce sites, 17 with readable policy. Snapshot: 2026-09-13

29.4%
block ≥1 AI crawler (5/17)
Bytespider
most-blocked bot here (4 sites)
1
publish llms.txt
Sitellms.txtGPTBotClaudeBotGoogle-ExtendedPerplexityBotCCBotBytespider
instacart.com — blockedblockedblockedblockedblockedblocked
amazon.com — blockedblockedblockedblockedblockedblocked
ebay.com — blockedblockedrestrictedblockedblockedblocked
chewy.com — restrictedrestrictedrestrictedrestrictedrestrictedrestricted
temu.com — restrictedrestrictedrestrictedrestrictedallowedblocked
adidas.com ? unknownunknownunknownunknownunknownunknown
aliexpress.com ? restrictedrestrictedrestrictedrestrictedrestrictedrestricted
bestbuy.com — restrictedrestrictedrestrictedrestrictedrestrictedrestricted
costco.com ? unknownunknownunknownunknownunknownunknown
doordash.com — restrictedrestrictedrestrictedrestrictedrestrictedrestricted
etsy.com — restrictedrestrictedrestrictedrestrictedrestrictedrestricted
homedepot.com — restrictedrestrictedrestrictedrestrictedrestrictedrestricted
ikea.com — restrictedrestrictedrestrictedrestrictedrestrictedrestricted
kroger.com ? unknownunknownunknownunknownunknownunknown
lowes.com ? unknownunknownunknownunknownunknownunknown
nike.com — restrictedrestrictedrestrictedrestrictedrestrictedrestricted
sephora.com ? unknownunknownunknownunknownunknownunknown
shein.com ? restrictedrestrictedrestrictedrestrictedrestrictedrestricted
target.com yes restrictedrestrictedrestrictedrestrictedrestrictedrestricted
ubereats.com — restrictedrestrictedrestrictedrestrictedrestrictedrestricted
walmart.com — restrictedrestrictedrestrictedrestrictedrestrictedrestricted
wayfair.com ? restrictedrestrictedrestrictedrestrictedrestrictedrestricted