← all sites

forter.com

forter.com currently blocks 3 of the 16 AI crawlers we track. Snapshot: 2026-08-25

Category
top1k
robots.txt
readable — view live file
Default (*) policy
restricted
llms.txt
published — view (an on-ramp written for AI readers)
Machine-readable
JSON for this site

All 16 tracked AI bots

BotOperatorPurposeStatusHow it's set
GPTBotOpenAItrainingallowednamed explicitly
ChatGPT-UserOpenAIfetchallowednamed explicitly
OAI-SearchBotOpenAIsearchallowednamed explicitly
ClaudeBotAnthropictrainingallowednamed explicitly
Claude-UserAnthropicfetchallowednamed explicitly
Claude-SearchBotAnthropicsearchallowednamed explicitly
Google-ExtendedGoogletrainingallowednamed explicitly
Applebot-ExtendedAppletrainingallowednamed explicitly
PerplexityBotPerplexitysearchallowednamed explicitly
Perplexity-UserPerplexityfetchallowednamed explicitly
CCBotCommon Crawltrainingblockednamed explicitly
BytespiderByteDancetrainingblockednamed explicitly
meta-externalagentMetatrainingblockednamed explicitly
AmazonbotAmazontrainingallowednamed explicitly
DuckAssistBotDuckDuckGosearchrestricted*default (*) rules
MistralAI-UserMistralfetchallowednamed explicitly

Policy history

Tracking began 2026-08-25 (index founding). Changes to this site's AI policy will appear here as daily crawls accumulate.