""It's because they are reliant on memorization and retrieval, and the game is something they've never seen before. They've never played that particular game before or games like it, because each one is unique. So they're lost. But a human is generally intelligent. A human is never lost. A human figures it out on the fly because they have fluid intelligence.""
""Models have a lot of abstractions encoded in them. They have in fact more knowledge than you do. But they have very low ability to recombine that knowledge at test time to make sense of something they've never seen before. It's the way the entire paradigm works. We are really good at absorbing knowledge, absorbing lots and lots of patterns. Better than the human brain.""
Francois Chollet introduced the ARC-AGI-3 benchmark to highlight AI's struggles with novel tasks. Current AI models rely on memorization, making them ineffective in unfamiliar scenarios. The benchmark involves simplistic video games that humans can master but AI cannot. Chollet emphasizes that while AI models possess extensive knowledge, they lack the ability to recombine that knowledge effectively in new contexts, unlike humans who can adapt and apply past experiences to solve problems.
Read at Fast Company
Unable to calculate read time
Collection
[
|
...
]