← all sites
Classifieds sites vs AI crawlers
1 tracked classifieds sites, 1 with readable policy. Snapshot: 2026-08-25
0%
block ≥1 AI crawler (0/1)
—
most-blocked bot here
0
publish llms.txt
| Site | llms.txt | GPTBot | ClaudeBot | Google-Extended | PerplexityBot | CCBot | Bytespider |
|---|---|---|---|---|---|---|---|
| craigslist.org | — | restricted* | restricted* | restricted* | restricted* | restricted* | restricted* |