Auto-Regressive LLMs have a role to play: turning abstract ideas into token sequences (words, actions, code…).
But abstract ideas should be elaborated through planning/reasoning in representation space.
AR-LLMs go directly from prompt to answer, skipping the step of reasoning

→ View original post on X — @ylecun,