It’s a cool analogy but traditional software already satisfies it – there are “worker drones” delivering, filtering and ranking posts/emails etc etc. So imo the analogy is subtle. Eg maybe AI allows a lot more people to issue new diverse commands to the technosphere. Or it’s a
@karpathy
-
Manual Backpropagation Wasn’t Actually a Major Problem
By
–
Yeah except it wasn’t actually that bad. I mean it was a bit annoying, code bloating and you’d have to run grad check, but it also didn’t feel like a major impediment after a bit of practice. I don’t recall spending significant portion of my time deriving/writing backward pass.
-
LLM domain training should produce manuals not weight updates
By
–
yes exactly, "training" an LLM on a target domain should output a manual not a weight diff.
-
LLM Self-Awareness in Task Adaptation and Problem-Solving
By
–
This is not the core issue. The core issue is that the LLM has to autonomously and in general way figure out that it is natively not well adapted to do this task in its head, that it doesn’t succeed in doing so, and that it should do this and that instead to solve it.
-
Missing Major LLM Learning Paradigm Beyond Pretraining and Finetuning
By
–
We're missing (at least one) major paradigm for LLM learning. Not sure what to call it, possibly it has a name – system prompt learning? Pretraining is for knowledge.
Finetuning (SL/RL) is for habitual behavior. Both of these involve a change in parameters but a lot of human -
Balancing Mathematical and Physical Perspectives in Computer Science Education
By
–
A major mistake I made in my undergrad is that I focused way too much on mathematical lens of computing – computability, decidability, asymptotic complexity etc. And too little on physical lens – energy/heat of state change, data locality, parallelism, computer architecture. The
-
DevOps Challenges: LLM Automation and Cross-Service Integration
By
–
so fun!! 😀 The biggest issue by far is the devops part. Services have to inter-operate and allow autonomy. I don't want to follow these instructions manually, I want my LLM to do everything. (And I don't want to run locally because I want to access on iPhone on the go.)
-
Building a Web App Through Vibe Coding: Modern Development Experience
By
–
I attended a vibe coding hackathon recently and used the chance to build a web app (with auth, payments, deploy, etc.). I tinker but I am not a web dev by background, so besides the app, I was very interested in what it's like to vibe code a full web app today. As such, I wrote
-
The Future GUI of LLM Interfaces Will Be Visual, Not Text-Based
By
–
"Chatting" with LLM feels like using an 80s computer terminal. The GUI hasn't been invented, yet but imo some properties of it can start to be predicted. 1 it will be visual (like GUIs of the past) because vision (pictures, charts, animations, not so much reading) is the 10-lane