Contextures: The Mechanism of Representation Learning This work introduces contexture theory, a unified mathematical framework that explains what foundation models actually learn during pretraining and why these learned representations generalize to diverse downstream tasks.

→ View original post on X — @askalphaxiv