In 1991, the foundations of Transformers, pretraining, distillation, and world models were already being built. These have helped shape my own thinking, from my time at Google Brain to our work on Improvement.

→ View original post on X — @hardmaru