Etsy Migrates 1000-Shard, 425 TB MySQL Sharding Architecture to Vitess
Briefly

Etsy Migrates 1000-Shard, 425 TB MySQL Sharding Architecture to Vitess
"With this new infrastructure in place, we were ready to start exploring vindexes, which define sharding strategies within Vitess. Since the ORM's shard mappings are random and not algorithmic, using one of these out-of-the-box would require re-sharding all of our data - a process that would be manual and likely take years."
"Etsy has used a sharded MySQL architecture since around 2010 to store most of its production data, with proprietary sharding logic, approximately 1000 shards, and 425 TB of data, serving 1.7 million requests per second."
Etsy transitioned its MySQL sharding infrastructure to Vitess, allowing for improved shard routing and resharding capabilities. The migration involved using vindexes to define data mapping and query routing. Custom vindexes were developed to integrate existing shard logic, avoiding the complexities of manual data re-sharding. Since 2010, Etsy has utilized a sharded MySQL architecture with proprietary logic, managing approximately 1000 shards and 425 TB of data, while serving 1.7 million requests per second through an internal ORM layer.
Read at InfoQ
Unable to calculate read time
[
|
]