Going back to general paper reads:
> MiniMax's new MoE LLM reaches SOTA performance with 4M tokens context length This work from Chinese startup @minimax_ai introduces a novel architecture that achieves state-of-the-art performance while handling context windows up to 4

→ View original post on X — @aymericroucher