The difference between these models on the leaderboard is minimal too. I also expected this comparison to be done in bf16, which is the precision in which the model was trained and released in.

→ View original post on X — @karpathy,