Actually, backropagation is one of the things that we know will perdure.
Certainly, learning through gradient-based optimization is here to stay.
Backpropagation is merely the way the gradient is estimated. To get rid of backprop, you would have to replace gradient-based

→ View original post on X — @ylecun,