H3 – an approach to reduce the gap, in terms of performance and hardware utilization, between state space models and attention for language modeling. 3 of 11

→ View original post on X — @dair_ai