I fetched /llms.txt from the Tranco top 1,000,000 domains. The run agreed with its own smoke test to about 99% and was still wrong in three ...

I scanned the Tranco top 1,000,000 domains to measure how much of the web runs managed bot defense. The final answer is 53.5% of reachable s...