According to reports, the training process for OpenAI's GPT-4... required up to 62,000 megawatt-hours. That's equivalent to the energy needs of 1,000 U.S. households for over 5 years.
Meta's new AI supercluster will include 350,000 NVIDIA H100 GPUs, while X and Google... are also building massive hardware projects to power their own models. It's a huge resource burden.
To provide some perspective... Visual Capitalist have put together an overview of Microsoft's rising electricity needs as it continues to work with OpenAI on its projects.
Collection
[
|
...
]