← all sites
Automotive sites vs AI crawlers
6 tracked automotive sites, 5 with readable policy. Snapshot: 2026-08-25
40%
block ≥1 AI crawler (2/5)
GPTBot
most-blocked bot here (1 sites)
2
publish llms.txt
| Site | llms.txt | GPTBot | ClaudeBot | Google-Extended | PerplexityBot | CCBot | Bytespider |
|---|---|---|---|---|---|---|---|
| edmunds.com | — | blocked | blocked | restricted* | restricted* | restricted* | blocked |
| kbb.com | yes | restricted* | restricted* | restricted* | restricted | restricted | restricted* |
| autotrader.com | — | restricted | restricted* | restricted* | restricted | restricted | restricted* |
| carfax.com | — | restricted* | restricted* | restricted* | restricted* | restricted* | restricted* |
| cars.com | — | unknown | unknown | unknown | unknown | unknown | unknown |
| carvana.com | yes | restricted* | restricted* | restricted* | restricted* | restricted* | restricted* |