Whatever it is that we learned through evolution has to be squeezed in 800MB (the size of the genome, uncompressed).
most of it is just low-level biochemical machinery. Even a tiny LLM requires 14GB.

→ View original post on X — @ylecun,