← all sites

Sports sites vs AI crawlers

9 tracked sports sites, 9 with readable policy. Snapshot: 2026-09-13

66.7%
block ≥1 AI crawler (6/9)
GPTBot
most-blocked bot here (5 sites)
0
publish llms.txt
Sitellms.txtGPTBotClaudeBotGoogle-ExtendedPerplexityBotCCBotBytespider
theathletic.com — blockedblockedblockedblockedblockedblocked
flashscore.com — restrictedrestrictedrestrictedrestrictedblockedblocked
nba.com — blockedblockedblockedblockedblockedrestricted
espn.com ? blockedrestrictedblockedrestrictedblockedblocked
bleacherreport.com — blockedrestrictedblockedrestrictedblockedrestricted
cbssports.com — blockedrestrictedrestrictedrestrictedrestrictedrestricted
mlb.com — restrictedrestrictedrestrictedrestrictedrestrictedrestricted
nfl.com — restrictedrestrictedrestrictedrestrictedrestrictedrestricted
nhl.com — restrictedrestrictedrestrictedrestrictedrestrictedrestricted