Uber's recent enhancement to Kafka through the addition of tiered storage aims to address scalability challenges, allowing independent scaling of storage from compute resources.
Traditionally, scaling Kafka storage requires adding broker nodes, which leads to unnecessary memory and CPU costs. Tiered storage presents a more cost-effective solution.
The tiered storage architecture fundamentally splits storage into local and remote tiers, enabling organizations to meet their specific use case retention policies.
With tiered storage, organizations can achieve elasticity in resource allocation, isolating latency-sensitive data for faster access while leveraging cost-efficient remote storage for older data.
Collection
[
|
...
]