Yes. yes LLMs are not just matrix multiplication but adding that there are non-linear functions as well doesn't really do anything to resolve the central mystery of why these models can do what they do. And here is the source of Wolfram's paragraph:
LLMs Beyond Matrix Multiplication: Understanding Model Capabilities
By
–
Leave a Reply