They made the choice even before evals. I.e., just looking at the training loss

→ View original post on X — @rasbt