could definitely see it; we might see the production : consumption ratio lift a lot as a result of gen ai, bullish!
@karpathy
-
Llama 1B Inference Optimized in Single CUDA Kernel
By
–
So so so cool. Llama 1B batch one inference in one single CUDA kernel, deleting synchronization boundaries imposed by breaking the computation into a series of kernels called in sequence. The *optimal* orchestration of compute and memory is only achievable in this way.
-
AI-free zones at parties as a safe space solution
By
–
Alternative solution I am fond of is parties should have a designated “no AI” circle drawn on the floor. A little safe space.
-
Silent Bugs: The Deep Learning Horror of Misconfigured Parameters
By
–
Deep Learning horror genre That fear of a kwarg that isn’t set right, not erroring, only silently making your results slightly worse.
-
Underestimating the Power and Generality of Text Generation
By
–
Yeah, I guess I didn't appreciate the power and generality of text generation, like at all. You can sense it in my blog post I think; I write about char-rnn as this neat gimmick to generate hallucinated linux source code etc. It didn't occur to me at all that a text generation
-
Timeline Compression: From Char-RNN to Modern AI Capabilities
By
–
Hmm putting aside the specifics of 2030 etc, and just talking about "timeline compression", I think around the time of char-rnn (~2015), if someone said something like this to me, or if I read it anywhere: "It's quite possible that if you make char-rnn bigger and then finetune
-
Claude 4 Opus Solves Problem After 4 Hints, o3 Shows Improvement
By
–
fyi for anyone interested later, e.g. the new Claude 4 Opus gets there after 4 hints https://
claude.ai/share/33072dd0
-a760-4b0f-8b73-6c0bb4a883ad
…
Other LLMs do similar except – o3 didn't get it yesterday but when I tried this morning it did and now I can't tell if that's just due to the new conversation memory -
SOTA LLMs Struggle with Complex Explanations
By
–
It’s ok all sota LLMs don’t get it either and give terrible “explanations” I think it’s too coded. Felt cute might delete later
-
Rethinking Software: From Professional-Built Apps to User Liberation
By
–
I missed this post but love it & the term! Definitely, we currently think of software as something professionals write and maintain for large cost, and as a user you go out searching for 1-of-k app for your need. You're constrained to what exists. To fully "free your mind" Matrix