2). xLSTM – attempts to scale LSTMs to billions of parameters using techniques from modern LLMs; to enable LSTMs the ability to revise storage decisions, they introduce exponential gating and a new memory mixing mechanism…

→ View original post on X — @dair_ai