Cloudflare and ETH Zurich Outline Approaches for AI-Driven Cache Optimization
Cloudflare and ETH Zurich tackle AI traffic challenges.

Cloudflare and ETH Zurich have identified significant operational challenges posed by AI-driven crawler traffic, which now exceeds 10 billion requests weekly. This surge in AI bot activity, accounting for about a third of Cloudflare's traffic, disrupts traditional caching strategies due to unique access patterns that differ from human browsing. To enhance cache efficiency, they propose AI-aware caching strategies, including separating human and AI traffic into distinct tiers and exploring adaptive machine learning policies.
Key Takeaways
- 1.
AI bot traffic now exceeds 10 billion requests per week on Cloudflare.
- 2.
AI crawlers account for roughly 80 percent of self-identified bot requests.
- 3.
Proposed solutions include AI-aware caching strategies and distinct cache tiers.
Get your personalized feed
Trace groups the biggest stories, videos, and discussions into one feed so you can stay current without scanning ten tabs.
Try Trace free