We had resnets in the 90s, in the form of neural nets with direct linear connections between input and output.

→ View original post on X — @pmddomingos