Auto-Regressive LLMs have a role to play: turning abstract ideas into token sequences (words, actions, code…).
But abstract ideas should be elaborated through planning/reasoning in representation space.
AR-LLMs go directly from prompt to answer, skipping the step of reasoning
@ylecun
-
Auto-Regressive LLMs: From Prompt to Answer Without Reasoning
By
–
-
Ego-Exo4d: Large-Scale Human Activity Video Dataset
By
–
Ego-Exo4d: a large dataset of videos of people doing stuff. https://t.co/JXf209gHLb
— Yann LeCun (@ylecun) 14 décembre 2023Ego-Exo4d: a large dataset of videos of people doing stuff.
-
VIC Training with Randall at NeurIPS Conference
By
–
VICReging with Randall at NeurIPS. https://
arxiv.org/abs/2303.00633 -
Meta-FAIR Hiring Scientists for Advanced Machine Intelligence Research
By
–
How to make machines understand the world, reason, plan, and learn as efficiently as animals humans? Meta-FAIR is hiring scientists to work on this question. We call this Advanced Machine Intelligence (AMI).
Help us build the next generation of AI. Open positions are available -
Reverse Engineering Self-Supervised Learning at NeurIPS
By
–
With Ravid and Ido in front of our NeurIPS poster "reverse engineering Self-Supervised Learning" https://
arxiv.org/abs/2305.15614 -
Meta showcases AI innovations at NeurIPS conference
By
–
Selfying with the NeurIPS crowd at the Meta booth.
-
AI Evolution: From Current LLMs to Next Generation Systems
By
–
"Between extinction and renaissance: what AI can do for us"
A fireside chat with my former Meta colleague Jerome Pesenti hosted by the Transatlantic Leaders Forum last month in New York. We talk about AI, why current LLM suck (yet are useful), and what the next steps in AI might -
Foundation Model Regulation Harms AI Research Development
By
–
Regulating foundation models is regulating research and development. That is bad.
There is absolutely no reason for it, except for highly speculative and improbable scenarios.
Regulating products is fine.
But regulation R&D is ridiculous. -
EU AI Act Foundation Model Regulation Debate Continues
By
–
EU AI Act: it's not over yet.
Regulating foundation models is a bad idea that was added late in the text and rightfully fought against by Macron's government. https://
ft.com/content/9339d1
04-7b0c-42b8-9316-72226dd4e4c0
… -
Intelligence Alone Doesn’t Drive Human Domination and Success
By
–
If it were true that raw intelligence was sufficient for a human to want to dominate others and succeed at it, then Albert Einstein, Richard Feynman, Leonard Euler, Niels Abel, Kurt Gödel and other scientists would have been both rich and powerful, and they were neither.
1.