Humans can spend a large amount of time thinking about a problem without outputting any "token".
In other words, there are iterative processes in the brain (e.g. implemented by recurrent networks) that are impossible to produce by an AR-LLM.
Brain iterative processes impossible for autoregressive LLMs
By
–