Reposting this answer to a question from @geoffreyhinton about whether I think LLMs "understand" what they say.
I point out what I think is missing from current architectures to reach cat-level intelligence (never mind human level): world models and planning/reasoning abilities.
@ylecun
-
LLMs Understanding: Missing World Models and Planning Abilities
By
–
-
Rethinking General Intelligence: Beyond Human-Centric AI Assumptions
By
–
That's why we don't think that human like intelligence is the on,y form, and also why I think "general intelligence " is a stupid name based on Tue wrong assumption that human intelligence is general.
-
Code Determinism Makes Programming Fundamentally Easy
By
–
Code is easy for the same reason chess is easy: it's deterministic, and the effects are fully observable.
-
Retrieval vs Understanding in AI Model Training
By
–
No. It has been trained to answer lots of questions, including the one I mention in that Lex video.
Do not confuse retrieval with understanding. -
How Effective Altruism Fell Into Internal Purity Spiral
By
–
How Effective Altruism fell down a kind of purity spiral.
-
Understanding LLMs: Limited Comprehension and Confabulation Issues
By
–
LLMs obviously have *some* understanding of what they read and generate.
But this understanding is very limited and superficial. Otherwise, they wouldn't confabulate so much and wouldn't make mistakes that are contrary to common sense. I have argued, since at least 2016, that AI -
A* vs MCTS: Planning Algorithms Explained by FAIR Researcher
By
–
Yuandong is one of several folks who have been working on planning at FAIR.
He explains the difference in applicability between A* (search for shortest path in a graph) and MCTS (search in an exponentially growing tree). -
Yuandong’s Planning Research Approaches at FAIR
By
–
Exactly.
Yuandong has been working on various approaches to planning at FAIR. -
Meta’s MusicGen and Demucs: Open Source AI Music Tools
By
–
Built with MusicGen and Demucs, both open source packages from Meta-FAIR.https://t.co/ahrh4OpfjWhttps://t.co/HGLNJ4ciUR https://t.co/B3RRW0GMle
— Yann LeCun (@ylecun) 25 novembre 2023Built with MusicGen and Demucs, both open source packages from Meta-FAIR. https://
huggingface.co/spaces/faceboo
k/MusicGen
… https://
github.com/facebookresear
ch/demucs
…