The model needs some recursive tape to perform variable-length symbolic computations. You could do this with activations, but it's somewhat nice to be able to read the trace. Then we need it to actually move purposefully, and use that tape well.

→ View original post on X — @honnibal