homeblogtags
  • Published on
    September 8, 2026 (Today)

    How Much of the Web Blocks Bots? I Got the Number Wrong Four Times First.

    Web-ScrapingAnti-botWeb-CrawlerGoKubernetesData-Study
    I scanned the Tranco top 1,000,000 domains to measure how much of the web runs managed bot defense. The final answer is 53.5% of reachable s...
© 2026 Built with 💖 by Tony Wang • With TypeScript, Next.js, Tailwind • Inspired by Leerob
Support me • Contact me
My projects: Crawlora • Namefy • BizHQ