Nvidia CEO Jensen Huang stated that computing power is projected to increase by a millionfold over the next decade, highlighting its role in generative AI advancements.
Huang emphasized that scaling laws provide predictable improvements in AI model performance as larger models gain access to more computing power and data.
Despite Huang's optimism, reports indicate that top AI labs are struggling to achieve strong performance gains, raising questions about the reliability of scaling laws.
Ilya Sutskever, former chief scientist of OpenAI, mentioned that the pre-training phase of AI is experiencing a plateau in growth, adding to concerns about scaling laws.
Collection
[
|
...
]