Nice one! XSA from https://
arxiv.org/abs/2603.09078? To keep the scope reasonable, I only focused on those that already made it into the flagship architectures. But maybe that's an interesting candidate for a follow-up on attention research candidates.

→ View original post on X — @rasbt