"Nvidia recently spent billions to license technology from a chip startup focused on low-latency AI computing, and also started selling standalone CPUs as part of its latest superchip system. And yesterday, Nvidia and Meta announced that the social media giant had agreed to buy billions of dollars worth of Nvidia chips to provide computing power for the social media giant's massive infrastructure projects-with Nvidia's CPUs as part of the deal."
"Meta previously estimated that by the end of 2024, it would have purchased 350,000 H100 chips from Nvidia, and that by the end of 2025 the company would have access to 1.3 million GPUs in total (though it wasn't clear whether those would all be Nvidia chips). As part of the latest announcement, Nvidia said that Meta would "build hyperscale data centers optimized for both training and inference in support of the company's long-term AI infrastructure roadmap.""
Nvidia has been defined by GPUs and benefited from generative AI driving GPU demand. The company is shifting to capture customers requiring efficient, less compute-intensive AI solutions by licensing low-latency technology and selling standalone CPUs within its superchip systems. Nvidia and Meta struck a multi-year, multi-billion-dollar deal for Nvidia chips including CPUs, expanding a close partnership. Meta plans large-scale purchases and plans to build hyperscale data centers optimized for training and inference, deploying Nvidia CPUs and millions of Blackwell and Rubin GPUs. Meta is the first major buyer of Nvidia's Grace CPU as a standalone chip.
Read at WIRED
Unable to calculate read time
Collection
[
|
...
]