What top sites tell Google and AI crawlers.

We read the public files of thousands of the web's top sites, platform by platform, and count what we find.

• October 29, 2026 · 6,692 sites

  Webflow, Framer, Wix, and Squarespace sites

  36.6%

  of Webflow homepages have no canonical tag

  Read the study

• October 29, 2026 · 4,763 sites

  WordPress sites and AI search

  14.9%

  block at least one AI bot in robots.txt

  Read the study

• October 29, 2026 · 5,033 sites

  Shopify stores and AI search

  95.7%

  serve Shopify's agents.md page for AI shopping agents

  Read the study