State of the Agent Web

A weekly read on how the web's doors are opening and closing to AI — written from our own daily census data.

#1 — The bigger the brand, the higher the wall

2026-08-25

Founding census: 31% of the top 1,000 sites block an AI crawler — but among household names it's 49%, and among news sites it's 94%.