Theoretical limitations of efficient Transformers (Mamba, etc.) are found by PKU and THU groups https://
arxiv.org/abs/2402.13934 (Published at ICML 2024) https://
arxiv.org/abs/2402.18510

→ View original post on X — @jiqizhixin