
"It's time for a new generation of faster flash storage, but not on your laptop or desktop. Micron's first PCIe 6.0 SSDs have entered mass production and promise eye-watering transfer rates of up to 28 GB/s. However, unless you're building flash storage arrays for AI, you won't have a use for them. At 18 watts, Micron's 9650 is designed squarely with datacenter duty in mind."
"High-speed storage has become a key bottleneck in AI datacenters where it's used to offload things like key-value caches - essentially the model's short-term memory - for better interactivity over extended sessions. The SSDs arrive ahead of the first PCIe 6.0 compatible CPUs from Intel, AMD, and Nvidia, which are expected to arrive later this year. Even if you could get your hands on Micron's fastest flash today, there's nothing to plug them into."
Micron's 9650 PCIe 6.0 SSDs have entered mass production, offering sequential read speeds up to 28 GB/s and sequential writes around 14 GB/s. The drives target datacenter deployments with 18-watt power envelopes and air- and liquid-cooled E1.S and E3.S form factors, and capacities planned from 7.68 TB to 30.72 TB. PCIe 6.0 doubles effective per-lane bandwidth over 5.0, yielding roughly double sequential read performance and 22–67 percent improvements in random IOPS (900,000 to 5.5 million). The drives are intended for arrayed configurations in AI datacenters to accelerate key-value caches and streaming workloads. Micron claims twice the streaming-read performance per power versus PCIe 5.0, with write efficiency trailing.
Read at Theregister
Unable to calculate read time
Collection
[
|
...
]