AI Dynamics

Global AI News Aggregator

About

On the nature of LLM memorization and data compression

that’s why i always say to a first approximation and when given space go into why’s it not just memorization . but some of it is effectively memorization, in same extended sense as a JPEG is.

→ View original post on X — @garymarcus