nearly everything in AI can be understood through the lens of compression – the architecture is just schema for when & how to compress
– optimization is a compression *process*, with its own compression level and duration
– (architecture + data + optimization) = model
– in other

→ View original post on X — @jxmnop