“δ-mem: Efficient Online Memory for Large Language Models” LLMs need long-term memory, but extending context is expensive and often doesn’t mean the model actually uses the history well. What this paper did is to store past information in a tiny 8×8 associative memory state,
