Nice theoretical analysis of SignSGD vs. AdamW and other methods.

→ View original post on X — @animaanandkumar