Equivariance to translations implies the use of convolutions *if* we insist on using linear operators.
There are lots of non-linear operators that are equivariant.

→ View original post on X — @ylecun