Pichai expressed that while AI development is not hitting a wall, he anticipates increased challenges in the coming years, stating, "The low-hanging fruit is gone. The hill is steeper."
Industry experts have pointed out existing bottlenecks in AI, particularly in providing high-quality data to models. As Ilya Sutskever noted, "Everyone is looking for the next thing" as scaling pretraining models has plateaued.
Pichai remains confident about AI's future, mentioning, "When you start out quickly scaling up, you can throw more compute and you can make progress, but you definitely are going to need deeper breakthroughs as we go to the next stage."
Collection
[
|
...
]