We've now exhausted basically the cumulative sum of human knowledge in AI training. That happened basically last year.
Musk suggested that synthetic data - data generated by AI models themselves - is the path forward. 'With synthetic data ... [AI] will sort of grade itself and go through this process of self-learning with synthetic data,' he said.
Training on synthetic data has other advantages, like cost savings. AI startup Writer claims its Palmyra X 004 model ... cost just $700,000 to develop - compared to estimates of $4.6 million for a comparably-sized OpenAI model.
Collection
[
|
...
]