"Microsoft CEO Satya Nadella on Thursday tweeted a video of his company's first deployed massive AI system - or AI "factory" as Nvidia likes to call them. He promised this is the "first of many" such Nvidia AI factories that will be deployed across Microsoft Azure's global data centers to run OpenAI workloads. Each system is a cluster of more than 4,600 Nvidia GB300s rack computers sporting the much-in-demand Blackwell Ultra GPU chip and connected via Nvidia's super-fast networking tech called InfiniBand."
"(Besides AI chips, Nvidia CEO Jensen Huang also had the foresight to corner the market on InfiniBand when his company acquired Mellanox for $6.9 billion in 2019.) Microsoft promises that it will be deploying "hundreds of thousands of Blackwell Ultra GPUs" as it rolls out these systems globally. While the size of these systems is eye-popping (and the company shared plenty more technical details for hardware enthusiasts to peruse), the timing of this announcement is also noteworthy."
"In 2025, OpenAI has racked up, by some estimates, $1 trillion in commitments to build its own data centers. And CEO Sam Altman said this week that more were coming. Microsoft clearly wants the world to know that it already has the data centers - more than 300 in 34 countries - and that they are "uniquely positioned" to "meet the demands of frontier AI today," the company said."
Microsoft posted a video of its first deployed massive AI system, described as an "AI factory" to run OpenAI workloads across Azure data centers. Each system comprises over 4,600 Nvidia GB300 rack computers equipped with Blackwell Ultra GPUs and linked via Nvidia InfiniBand networking. Microsoft plans to deploy hundreds of thousands of Blackwell Ultra GPUs globally as it scales these clusters. The announcement follows OpenAI deals with Nvidia and AMD and estimated 2025 commitments of around $1 trillion for OpenAI data centers. Microsoft operates more than 300 data centers in 34 countries and positions them to support next-generation models with hundreds of trillions of parameters. Microsoft CTO Kevin Scott will speak at TechCrunch Disrupt, October 27–29.
Read at TechCrunch
Unable to calculate read time
Collection
[
|
...
]