I wrote this thread because I spent the last ~decade, obsessing over directions that would make fastest progress in AI, and was very interested in language models (e.g. my semi-famous 2015 post "The Unreasonable Effectiveness of Recurrent Neural Networks" https://
karpathy.github.io/2015/05/21/rnn
-effectiveness/
…)

→ View original post on X — @karpathy,