I use this line about LLMs a lot – that they're a bunch of matrix multiplication – because I think it demystifies them A multiple GB file of floating point numbers you can download and run matrix multiplications against on your own machine is a bit less weird and frightening
LLMs Demystified: Matrix Multiplication and Local Inference
By
–
Leave a Reply