This was covered in Hinton's marvellous Coursera course btw. (Which also introduced rmsprop in passing)

→ View original post on X — @jeremyphoward