← all sites

snopes.com

snopes.com currently blocks 9 of the 16 AI crawlers we track. Snapshot: 2026-08-25

Category
reference
robots.txt
readable — view live file
Default (*) policy
allowed
llms.txt
none found
Machine-readable
JSON for this site

All 16 tracked AI bots

BotOperatorPurposeStatusHow it's set
GPTBotOpenAItrainingblockednamed explicitly
ChatGPT-UserOpenAIfetchblockednamed explicitly
OAI-SearchBotOpenAIsearchalloweddefault (*) rules
ClaudeBotAnthropictrainingblockednamed explicitly
Claude-UserAnthropicfetchalloweddefault (*) rules
Claude-SearchBotAnthropicsearchalloweddefault (*) rules
Google-ExtendedGoogletrainingalloweddefault (*) rules
Applebot-ExtendedAppletrainingblockednamed explicitly
PerplexityBotPerplexitysearchblockednamed explicitly
Perplexity-UserPerplexityfetchalloweddefault (*) rules
CCBotCommon Crawltrainingblockednamed explicitly
BytespiderByteDancetrainingblockednamed explicitly
meta-externalagentMetatrainingblockednamed explicitly
AmazonbotAmazontrainingblockednamed explicitly
DuckAssistBotDuckDuckGosearchalloweddefault (*) rules
MistralAI-UserMistralfetchalloweddefault (*) rules

Policy history

Tracking began 2026-08-25 (index founding). Changes to this site's AI policy will appear here as daily crawls accumulate.