← all sites

kbb.com

kbb.com currently blocks 1 of the 16 AI crawlers we track. Snapshot: 2026-08-25

Category
auto
robots.txt
readable — view live file
Default (*) policy
restricted
llms.txt
published — view (an on-ramp written for AI readers)
Machine-readable
JSON for this site

All 16 tracked AI bots

BotOperatorPurposeStatusHow it's set
GPTBotOpenAItrainingrestricted*default (*) rules
ChatGPT-UserOpenAIfetchrestricted*default (*) rules
OAI-SearchBotOpenAIsearchrestricted*default (*) rules
ClaudeBotAnthropictrainingrestricted*default (*) rules
Claude-UserAnthropicfetchrestrictednamed explicitly
Claude-SearchBotAnthropicsearchrestrictednamed explicitly
Google-ExtendedGoogletrainingrestricted*default (*) rules
Applebot-ExtendedAppletrainingrestricted*default (*) rules
PerplexityBotPerplexitysearchrestrictednamed explicitly
Perplexity-UserPerplexityfetchrestrictednamed explicitly
CCBotCommon Crawltrainingrestrictednamed explicitly
BytespiderByteDancetrainingrestricted*default (*) rules
meta-externalagentMetatrainingrestricted*default (*) rules
AmazonbotAmazontrainingblockednamed explicitly
DuckAssistBotDuckDuckGosearchrestrictednamed explicitly
MistralAI-UserMistralfetchrestricted*default (*) rules

Policy history

Tracking began 2026-08-25 (index founding). Changes to this site's AI policy will appear here as daily crawls accumulate.