And in yet another instance of the AI comedy, weight decay was invented to control overfitting, but what it really does is improve training loss.

→ View original post on X — @pmddomingos