← all sites

Food sites vs AI crawlers

7 tracked food sites, 6 with readable policy. Snapshot: 2026-09-13

83.3%
block ≥1 AI crawler (5/6)
ClaudeBot
most-blocked bot here (5 sites)
0
publish llms.txt
Sitellms.txtGPTBotClaudeBotGoogle-ExtendedPerplexityBotCCBotBytespider
yelp.com — blockedblockedblockedblockedblockedblocked
allrecipes.com ? restrictedblockedblockedblockedblockedblocked
seriouseats.com ? restrictedblockedblockedblockedblockedblocked
bonappetit.com — restrictedblockedblockedblockedblockedblocked
epicurious.com ? restrictedblockedblockedblockedblockedblocked
foodnetwork.com — restrictedrestrictedrestrictedrestrictedrestrictedrestricted
opentable.com ? unknownunknownunknownunknownunknownunknown