The key distinction: Token-level SSL asks the model to recover the hidden tree through the leaves. Latent prediction lets the model climb the tree. Once one abstraction level is learned, it becomes the substrate for learning the next.

→ View original post on X — @montreal_ai