It's remarkable both that backprop is just a simple optimization scheme and that it took a psychologist to come up with it.

→ View original post on X — @pmddomingos