AI Dynamics

Global AI News Aggregator

About

Grassmann flows replace attention with geometric evolution

The alternative is mathematically beautiful: Grassmann flows replace attention with controlled geometric evolution on a manifold. – Reduce hidden states to r=32 dimensions (from d=256)
– Encode token pairs as 2D subspaces on Gr(2,r)
– Use Plücker coordinates to create geometric

→ View original post on X — @godofprompt