What if your LLM could remember everything without rewriting its entire memory? Researchers from NTU, Fudan, and Mind Lab present δ-mem. It’s a tiny memory module that compresses past info into a fixed-size matrix, updated via a simple delta rule. This matrix then tweaks the
δ-mem: Tiny memory module compresses info via delta rule for LLMs
By
–
