/2 Google gives RNNs growing memory so they can handle longer inputs without large compute increases. Google Research proposes Memory Caching (MC), a method that extends RNNs with memory that grows over time. Transformers solve long-context tasks using KV-cache but require
Google Proposes Memory Caching to Extend RNN Long-Context Handling
By
–
