It is intuitively obvious that reasoning in continuous embedding space is dramatically more powerful than reasoning in discrete token space.
This paper from @tydsh and team show that it is the case theoretically.

→ View original post on X — @ylecun,