Skip to content

Travel sites vs AI crawlers

14 tracked travel sites, 12 with readable policy. Snapshot: 2026-08-25

16.7%

block ≥1 AI crawler (2/12)

meta-externalagent

most-blocked bot here (2 sites)

2

publish llms.txt

Site	llms.txt	GPTBot	ClaudeBot	Google-Extended	PerplexityBot	CCBot	Bytespider
tripadvisor.com	—	blocked	blocked	blocked	restricted	blocked	blocked
skyscanner.com	—	restricted^*	restricted^*	restricted^*	restricted^*	restricted^*	restricted^*
aa.com	—	restricted^*	restricted^*	restricted^*	restricted^*	restricted^*	restricted^*
airbnb.com	—	restricted	restricted	restricted^*	restricted	restricted^*	restricted^*
booking.com	—	restricted^*	restricted^*	restricted^*	restricted^*	restricted^*	restricted^*
delta.com	—	restricted^*	restricted^*	restricted^*	restricted^*	restricted^*	restricted^*
expedia.com	yes	restricted^*	restricted^*	restricted^*	restricted	restricted^*	restricted^*
hilton.com	—	restricted^*	restricted^*	restricted^*	restricted^*	restricted^*	restricted^*
hotels.com	—	unknown	unknown	unknown	unknown	unknown	unknown
kayak.com	yes	restricted^*	restricted^*	restricted^*	restricted^*	restricted^*	restricted^*
marriott.com	—	restricted^*	restricted^*	restricted^*	restricted^*	restricted^*	restricted^*
southwest.com	—	restricted^*	restricted^*	restricted^*	restricted^*	restricted^*	restricted^*
united.com	—	unknown	unknown	unknown	unknown	unknown	unknown
vrbo.com	—	restricted^*	restricted^*	restricted^*	restricted	restricted^*	restricted^*