I’m very proud of our team for open sourcing RecurrentGemma. Yes, recurrence is back and it results in huge gains at inference time. Just look at the impressive throughput plot below. For details, please see the paper and GitHub page: Griffin: Mixing Gated Linear Recurrences

→ View original post on X — @nandodf