"Storefront serves as a reverse proxy that actively distributes S3 requests across backend nodes, addressing the limitations of DNS round-robin traffic distribution. This approach prevents hotspots and ensures a more balanced load across the system."
"The implementation of Storefront in Rust, built on the Pingora framework, allows for real-time evaluation of backend availability and request load, significantly improving the efficiency of object storage traffic management."
"Operational safeguards, such as IO timeouts, were introduced to handle scenarios where S3 clients fail to fully consume HTTP responses, thereby preventing backend connection pool exhaustion and enhancing overall reliability."
Agoda engineers created Storefront, an internal S3-compatible proxy, to improve load balancing and reliability for object storage traffic. The proxy addresses limitations of DNS-based load distribution, which caused uneven traffic across backend nodes. Storefront actively distributes requests based on real-time backend availability and request load, using a refined latency-aware scoring algorithm. It also includes operational safeguards like IO timeouts to prevent backend connection pool exhaustion. The implementation is built in Rust on the Pingora framework, enhancing operational control for data processing and analytics workloads.
Read at InfoQ
Unable to calculate read time
Collection
[
|
...
]