Guess who was the 1st to point out that Adam can be used for pretty much everything? (Answer: it was @fastdotai back in 2018 — @GuggerSylvain
's first research project in fact!) https://
fast.ai/posts/2018-07-
02-adam-weight-decay.html
…

→ View original post on X — @jeremyphoward