AI Dynamics

Global AI News Aggregator

About

LLM Training for Lossless Data Compression Internet Archive

It is generally frowned upon to have LLMs precisely regurgitate part of their training set, but it is an interesting question how you could use LLM training to nearly losslesly compress a huge corpus like the entirety of the Internet Archive. The Hutter Prize is for perfect

→ View original post on X — @id_aa_carmack,