← all sites
Sports sites vs AI crawlers
9 tracked sports sites, 9 with readable policy. Snapshot: 2026-08-25
66.7%
block ≥1 AI crawler (6/9)
GPTBot
most-blocked bot here (5 sites)
0
publish llms.txt
| Site | llms.txt | GPTBot | ClaudeBot | Google-Extended | PerplexityBot | CCBot | Bytespider |
|---|---|---|---|---|---|---|---|
| nba.com | — | blocked | blocked | blocked | blocked | blocked | restricted* |
| theathletic.com | — | blocked | blocked | blocked | blocked | blocked | blocked |
| espn.com | — | blocked | restricted* | blocked | restricted* | blocked | blocked |
| flashscore.com | — | restricted* | restricted* | restricted* | restricted* | blocked | blocked |
| bleacherreport.com | — | blocked | restricted* | blocked | restricted* | blocked | restricted* |
| cbssports.com | — | blocked | restricted* | restricted* | restricted* | restricted* | restricted* |
| mlb.com | — | restricted* | restricted* | restricted* | restricted* | restricted* | restricted* |
| nfl.com | — | restricted* | restricted* | restricted* | restricted* | restricted* | restricted* |
| nhl.com | — | restricted* | restricted* | restricted* | restricted* | restricted* | restricted* |