Google just solved an old RNN problem. A new paper from Google Research introduces "Memory Caching," and the idea is almost too simple to believe. Here's the problem it solves: Modern RNNs compress the entire input into a single fixed-size memory state. As sequences get

→ View original post on X — @akshay_pachaar,