ChatGPT in a nutshell. Framework predicted by @ylecun in 7 years ago.
Bulk of compute (cake) on predicting next word from internet.
Next small fraction of compute (icing) on imitating select curated footprints of humans.
And final smallest fraction (cherry) on modeling their

→ View original post on X — @aravsrinivas