Agree, Galactica showed that training on scientific papers as well as code improved logical reasoning in comparison. Orthogonally, there's another hypothesis that the interactive format has value: whether it produces more value to users when used in a interaction loop.

→ View original post on X — @alexjc,