This used to always be true — If you ask an LLM "Why did you say that?" the answer is rationalization / guessing. It's only possibly reasoning if it comes before the answer. Code use is the asterisk: Interpreted code blocks serve as a de facto "inner monologue" it can recall.
LLM reasoning vs rationalization and code as inner monologue
By
–