And the notion of "compressibility" says nothing about the tiny subset of sequences that are compressible.
The fact that the real-world sequences we choose to model are easily "compressed" by models that are simple to represent in the same world sounds a bit like a convenient

→ View original post on X — @ylecun,