Promoting Exploration in Memory-Augmented Adam using Critical Momenta paper page: https://
huggingface.co/papers/2307.09
638
… Adaptive gradient-based optimizers, particularly Adam, have left their mark in training large-scale deep learning models. The strength of such optimizers is that they

→ View original post on X — @_akhaliq