"The Surprising Effectiveness of Shared Memory in Looped Transformers" Looped Transformers usually maintain separate KV-caches for each pass, but this paper shows that sharing memory across loops can actually improve model quality while reducing memory usage. So Looped
Shared Memory Improves Looped Transformers While Reducing Cache Use
By
–
