You mean that reasoning may emerge from pre-training itself? I think that current-gen LLMs are capable of some reasoning w/o explicit reasoning methodology applied to them. But then, the tricky part is most LLMs nowadays have Q&A data in their pre-training set. And if you think

→ View original post on X — @rasbt,