That's very little information though.
The whole human genome is 3 billion base pairs.
That's 800MB uncompressed.
The difference between chimps and humans is 1% of that, or a mere 8MB.
Even a small 7B LLM is 14GB….

→ View original post on X — @ylecun,