← all sites
Travel sites vs AI crawlers
14 tracked travel sites, 12 with readable policy. Snapshot: 2026-09-13
25%
block ≥1 AI crawler (3/12)
meta-externalagent
most-blocked bot here (2 sites)
2
publish llms.txt
| Site | llms.txt | GPTBot | ClaudeBot | Google-Extended | PerplexityBot | CCBot | Bytespider |
|---|---|---|---|---|---|---|---|
| tripadvisor.com | ? | blocked | blocked | blocked | restricted | blocked | blocked |
| airbnb.com | — | restricted | restricted | restricted | restricted | restricted | restricted |
| skyscanner.com | — | restricted | restricted | restricted | restricted | restricted | restricted |
| aa.com | — | restricted | restricted | restricted | restricted | restricted | restricted |
| booking.com | — | restricted | restricted | restricted | restricted | restricted | restricted |
| delta.com | — | restricted | restricted | restricted | restricted | restricted | restricted |
| expedia.com | yes | restricted | restricted | restricted | restricted | restricted | restricted |
| hilton.com | — | restricted | restricted | restricted | restricted | restricted | restricted |
| hotels.com | ? | unknown | unknown | unknown | unknown | unknown | unknown |
| kayak.com | yes | restricted | restricted | restricted | restricted | restricted | restricted |
| marriott.com | — | restricted | restricted | restricted | restricted | restricted | restricted |
| southwest.com | — | restricted | restricted | restricted | restricted | restricted | restricted |
| united.com | ? | unknown | unknown | unknown | unknown | unknown | unknown |
| vrbo.com | ? | restricted | restricted | restricted | restricted | restricted | restricted |