Karpathy’s AutoResearch made this concrete. One markdown prompt. 630 lines of training code. One GPU. 2 days.
It ran 700 experiments and found 20 training optimizations.
Most people was impressed by on the 700 experiments.
But what most people missed out is what decided which 20
Karpathy’s AutoResearch: 700 Experiments, 20 Key Optimizations Found
By
–

Leave a Reply