← all sites
Automotive sites vs AI crawlers
6 tracked automotive sites, 5 with readable policy. Snapshot: 2026-09-13
40%
block ≥1 AI crawler (2/5)
GPTBot
most-blocked bot here (1 sites)
2
publish llms.txt
| Site | llms.txt | GPTBot | ClaudeBot | Google-Extended | PerplexityBot | CCBot | Bytespider |
|---|---|---|---|---|---|---|---|
| edmunds.com | — | blocked | blocked | restricted | restricted | restricted | blocked |
| kbb.com | yes | restricted | restricted | restricted | restricted | restricted | restricted |
| autotrader.com | ? | restricted | restricted | restricted | restricted | restricted | restricted |
| carfax.com | — | restricted | restricted | restricted | restricted | restricted | restricted |
| cars.com | ? | unknown | unknown | unknown | unknown | unknown | unknown |
| carvana.com | yes | restricted | restricted | restricted | restricted | restricted | restricted |