You think token embeddings just fell out of a tokenut tree? No, they exist in the context of all in which they live and what tokens came before them.

→ View original post on X — @goodside