8/ Patches Are All You Need – proposes ConvMixer, a parameter-efficient fully-convolutional model which replaces self-attention and MLP layers in ViTs with less-expressive depthwise and pointwise convolutional layers.

→ View original post on X — @dair_ai