AI Dynamics

Global AI News Aggregator

About

δ-mem: Tiny memory module compresses info via delta rule for LLMs

What if your LLM could remember everything without rewriting its entire memory? Researchers from NTU, Fudan, and Mind Lab present δ-mem. It’s a tiny memory module that compresses past info into a fixed-size matrix, updated via a simple delta rule. This matrix then tweaks the

→ View original post on X — @jiqizhixin