"Vahdat, a vice president at Google Cloud, presented slides showing the company needs to scale "the next 1000x in 4-5 years." While a thousandfold increase in compute capacity sounds ambitious by itself, Vahdat noted some key constraints: Google needs to be able to deliver this increase in capability, compute, and storage networking "for essentially the same cost and increasingly, the same power, the same energy level," he told employees during the meeting."
"OpenAI is planning to build six massive data centers across the US through its Stargate partnership project with SoftBank and Oracle, committing over $400 billion in the next three years to reach nearly 7 gigawatts of capacity. The company faces similar constraints serving its 800 million weekly ChatGPT users, with even paid subscribers regularly hitting usage limits for features like video synthesis and simulated reasoning models."
Google must double serving capacity every six months to meet AI demand and needs to scale roughly 1000x within four to five years. The company must deliver increases in capability, compute, and storage networking for essentially the same cost and increasingly the same power and energy levels. OpenAI plans six massive US data centers via the Stargate partnership with SoftBank and Oracle, committing over $400 billion in the next three years to reach nearly 7 gigawatts of capacity. ChatGPT serves about 800 million weekly users, and even paid subscribers regularly hit usage limits for advanced features.
Read at Ars Technica
Unable to calculate read time
Collection
[
|
...
]