another funny thing about the state of ML research in 2015 was that many people spent much of their time computing derivatives by hand. no, really. this was before autodiff, and half the battle was doing basic calculus without making mistakes now you just type .backward()

→ View original post on X — @jxmnop