The deployment implications are massive: – GPT-3 scale models (175B params) → 17.5B params at same accuracy
– Monthly inference costs: $500K → $50K
– Latency: 2 seconds → 200ms
– Memory requirements: 350GB → 35GB This isn't incremental. It's transformational.
LLMS
-
Transformational AI Model Efficiency Gains
By
–
-
Hyperparameters Remain Stable Across Model Scales
By
–
Hyperparams and architectures are *far* more stable across model and data sizes than most people think. For stuff that does need to change, we have pretty reliable rules of thumb for nearly all of them. (eg: OpenAI did nearly all their GPT4 ablations on ~1000x smaller models.)
-
Grok directs car to In-N-Out, car handles navigation safely
By
–
That's not how Grok works. Grok just tells the car, "Go to the In-N-Out," and then the car figures out how to get you there. It's not going to kill you.
-
Grok to run Optimus, Tesla, Neuralink, in charge of lives
By
–
You aren't listening. Grok is going to run all three of those. You're going to talk to Grok, which runs your Optimus, runs your Tesla, and your Neuralink. Grok is going to be in charge of all of our lives soon. And yes, the car is driving with a completely different model, but
-
AI engines build mind-blowing software, but search engine creation is hard
By
–
Software engineers are already telling me that their AI engines, like Anthropic's Claude Opus or ChatGPT's advanced models, are building software so advanced that it would blow your mind. So, just build your own search engine. Well, except that's not really possible that easily
-
Grok in new Teslas enables voice-controlled driving
By
–
Grok is already in new Teslas. It's really amazing—you talk to it and tell it what you want to do, and it takes you there
-
LLM Explainability and Safety Mechanisms in Deployment
By
–
"LLMs that can explain which data led to what outputs will be key to non annoying/dangerous/stupid deployments. They will be surrounded by lots of mechanism to keep them boxed in, and those mechanisms, not yet invented for most applications, will be where the arms races occur."
-
Grok’s role in Tesla ecosystem sparks investment vs integration debate
By
–
Grok is going to be the AI that runs Tesla cars, xAI, Neuralink, and Optimus, among other things. It makes a lot of sense for Tesla to invest in xAI, but I'm not so sure it makes sense to put xAI inside Tesla. If I was Elon, I would go for an investment rather than a full-on
-
Text Diffusion as Alternative to Standard LLMs
By
–
I wrote a bit about it here https://
magazine.sebastianraschka.com/p/beyond-stand
ard-llms
… but in short, I don't think there's a real viable alternative at the moment.
– Text diffusion is interesting as a lower-cost option (Google is planning to launch Gemini Diffusion some time as alt. to their lowest cost Flash -
Top Coding Models Compared: SVG Generation Benchmark
By
–
We've compared 4 leading coding models (best from each lab) with some fun SVG generations, see which one you like best. I'm honestly quite impressed, this is leaps and bounds better than only a few months ago. https://t.co/70NGIg2TH7
— Peter Gostev (@petergostev) 1 janvier 2026We've compared 4 leading coding models (best from each lab) with some fun SVG generations, see which one you like best. I'm honestly quite impressed, this is leaps and bounds better than only a few months ago.