← all sites

Entertainment sites vs AI crawlers

15 tracked entertainment sites, 13 with readable policy. Snapshot: 2026-09-13

69.2%
block ≥1 AI crawler (9/13)
Bytespider
most-blocked bot here (7 sites)
0
publish llms.txt
Sitellms.txtGPTBotClaudeBotGoogle-ExtendedPerplexityBotCCBotBytespider
ign.com — blockedblockedrestrictedblockedblockedblocked
netflix.com — restrictedrestrictedrestrictedrestrictedblockedblocked
polygon.com — blockedblockedblockedblockedblockedblocked
disneyplus.com — restrictedrestrictedrestrictedrestrictedrestrictedrestricted
hulu.com — restrictedrestrictedrestrictedrestrictedrestrictedrestricted
soundcloud.com — blockedblockedblockedblockedblockedblocked
kotaku.com — restrictedrestrictedrestrictedrestrictedblockedblocked
gamespot.com ? blockedblockedblockedallowedblockedblocked
pcgamer.com — restrictedrestrictedrestrictedrestrictedrestrictedblocked
epicgames.com ? unknownunknownunknownunknownunknownunknown
max.com — restrictedrestrictedrestrictedrestrictedrestrictedrestricted
minecraft.net ? unknownunknownunknownunknownunknownunknown
roblox.com — restrictedrestrictedrestrictedrestrictedrestrictedrestricted
spotify.com — restrictedrestrictedrestrictedrestrictedrestrictedrestricted
steampowered.com — restrictedrestrictedrestrictedrestrictedrestrictedrestricted