
Wow, a new and better optimizer! Researchers from Wuhan University, University of Macau, and University of Calgary present Anon. It features continuously tunable adaptivity, allowing it to interpolate between SGD-like and Adam-like behavior and even extrapolate beyond both. A
