Elon Musk's project Grok 3 will be 'something special' after training on 100,000 Nvidia H100 GPUs, each estimated between $30,000 and $40,000, costing billions.
Musk stated that Grok 2 required around 20,000 H100 GPUs to train, implying a significant increase to 100,000 GPUs for the upcoming Grok 3 version.
Collection
[
|
...
]