Cloudflare Year in Review: AI Bots Crawl Aggressively, Post-Quantum Encryption Hits 50%, Go Doubles
Briefly

Cloudflare Year in Review: AI Bots Crawl Aggressively, Post-Quantum Encryption Hits 50%, Go Doubles
"Leveraging data from the widespread Cloudflare infrastructure, including anonymized query data for traffic to the 1.1.1.1 public DNS resolver, the yearly report analyzes the disruptions, advances, and metrics that defined the Internet in 2025. The review is organized into different sections (traffic, AI, adoption & usage, connectivity, security, and email security) and uses the same methodologies as previous years. With global traffic growing 19% during the year and Google and Facebook still the most popular services, the report highlights significant growth for Starlink, up 2.3x year-over-year."
"Furthermore, Googlebot was responsible for over 28% of traffic from verified bots, with Google AdsBot (used to monitor sites where Google ads are served), Google Image Proxy (used to retrieve and cache images embedded in email messages), and GoogleOther further increasing the dominance of the search company. OpenAI's GPTBot and Microsoft Bingbot follow at 7.5% and 6%, respectively."
Global internet traffic increased 19% in 2025, with Google and Facebook remaining the most popular services. Starlink traffic rose 2.3x year-over-year. Googlebot generated the highest volume of request traffic, accounting for over 28% of traffic from verified bots while GPTBot and Bingbot contributed 7.5% and 6%. AI platforms crawled content aggressively while driving fewer referrals back to source sites, increasing crawl-to-refer ratios. Over 20% of automated API requests originated from Go-based clients, nearly doubling adoption. Post-quantum encryption saw broad adoption. Analyses used Cloudflare infrastructure, anonymized 1.1.1.1 DNS data, and Hilbert curve visualizations.
Read at InfoQ
Unable to calculate read time
[
|
]