Indeed, all too often, the end result is annoying and obnoxiously wrong. Worse still, it's erratically wrong. If I could count on its answers being mediocre, but reasonably accurate, I could work around it. I can't.
After all the hype for me, it was kind of a big disappointment. Users posting on the OpenAI developer forum have also noticed a significant decline in accuracy after the latest version of GPT was released last year.
One possibility is that these AIs were never quite as strong as they seemed — their training data was culled from places like Reddit and Twitter — but we were wowed by their ability to function at all.
Vaughan-Nichols is referring to the idea of 'model collapse,' a phenomenon when AI models deteriorate when they're fed AI-generated data, which is becoming increasingly prevalent as the Internet becomes more awash in AI-generated slop, from images to text.
[
Collection
]
[
|
...
]