Yes. yes LLMs are not just matrix multiplication but adding that there are non-linear functions as well doesn't really do anything to resolve the central mystery of why these models can do what they do. And here is the source of Wolfram's paragraph:

→ View original post on X — @emollick