AI Dynamics

Global AI News Aggregator

LLM Size vs Genome: Information Compression Limits

Not really.
That would have to be compressed in a tiny amount of information.
A small 7B LLM requires 14GB.
Your entire genome fits in 800MB (uncompressed).
The difference between human and chimp genome is 1% of that, or 8MB.
Not enough to encode a significant structure.

→ View original post on X — @ylecun,

Commentaires

Leave a Reply

Your email address will not be published. Required fields are marked *