The Cake first appeared in my talk at the NYU future of AI Symposium in early 2016.
Here is a video from my 2016 NIPS keynote.
The point was that there is much more knowledge to extract about the world using self-supervised learning from high-bandwidth sensory input such as

→ View original post on X — @ylecun,