It offers the ability to endow a kind of "memory" to models that are frozen in time, as well as lower the overall cost of LLM usage. Or as @bobvanluijt told me, a way to make a stateless tool more stateful.

→ View original post on X — @mattlynley,