"The artificial intelligence (AI) boom has fueled explosive growth for Nvidia ( NASDAQ:NVDA ), with its graphics processing units commanding the lion's share of the market for training and running large language models. This success has lured numerous companies into the fray, from startups to tech giants, all vying for a piece of the lucrative AI hardware pie. The latest is Alphabet ( NASDAQ:GOOG )( NASDAQ:GOOGL ), whose Google business stands out with the rollout of Ironwood, its seventh-generation Tensor Processing Unit (TPU)."
"In terms of speed, Ironwood is over four times faster than its previous model, Trillium, and up to 10 times quicker than the one before that. It comes with 192 gigabytes of fast-access memory per chip - six times more than Trillium - which helps process data without slowdowns. Google says it is its most power-saving TPU so far, with efficiency gains of nearly 30 times compared to the original version."
Rapid AI demand has driven Nvidia's explosive growth and spurred many companies to develop AI accelerators. Alphabet's Google released Ironwood, a seventh-generation Tensor Processing Unit focused on core AI calculations for training and inference. Ironwood delivers over four times the speed of Trillium, up to ten times versus earlier chips, and provides 192 GB of on-chip memory—six times that of Trillium. The TPU claims almost 30-fold energy-efficiency improvement relative to the original TPU and supports high-speed inter-chip links. Ironwood pods can scale to 9,216 chips with 1.77 petabytes of shared memory, enabling very large model workloads, but toppling Nvidia remains challenging.
Read at 24/7 Wall St.
Unable to calculate read time
Collection
[
|
...
]