a paradigm of modern AI that feels very behind is that model weights are trained every few months, but frozen between and during interactions real intelligent systems (such as human brains) update their parameters online maybe we'll get there in a couple years
Online Learning: The Missing Paradigm in Modern AI Systems
By
–