Every company needs a DM POC – someone high up who you can just DM the most obvious things and who shortcuts the PM hierarchy.
@karpathy
-
LLM Code Generation and Agent Classification Discussion
By
–
Yeah one more person pointed out already. I'd say it falls under "agent" because an LLM is still giving you a large chunk of code that you're slotting in.
-
NotebookLM Context Window vs RAG Trade-offs
By
–
I'd be afraid that NotebookLM is wired up to do RAG. It's not a lot of tokens. I want them in the context window. All of them and for sure.
-
LLM Training: RL vs SFT with In-Context Learning
By
–
"Don’t be difficult. I mean this is obvious." Sutton is right ofc. The analogue in LLM land to what humans do is something along the lines of: Given this math problem AND human example solution in the context, solve the problem. Reward of 1 if correct. It's not SFT, it's RL.
-
Using ChatGPT to analyze podcast transcripts and AI content
By
–
Something I am experimenting with. I copy pasted: 1) the full podcast transcript
2) the bitter lesson blog post
3) my full post above To ChatGPT. The interesting part is you can fork the conversation context to ask any questions and take it in whatever direction with chat: -
Sutton’s Bitter Lesson Shapes LLM Research Approaches
By
–
Finally had a chance to listen through this pod with Sutton, which was interesting and amusing.
— Andrej Karpathy (@karpathy) 1 octobre 2025
As background, Sutton's "The Bitter Lesson" has become a bit of biblical text in frontier LLM circles. Researchers routinely talk about and ask whether this or that approach or idea… https://t.co/EQ4snNmiTMFinally had a chance to listen through this pod with Sutton, which was interesting and amusing. As background, Sutton's "The Bitter Lesson" has become a bit of biblical text in frontier LLM circles. Researchers routinely talk about and ask whether this or that approach or idea
-
Dyson Spheres: Beyond Reasoning Toward Advanced Technology
By
–
We're not going to reason our way to Dyson spheres. Excited for you and all the best to the team!
-
AI Image Recognition Won’t Replace Radiologists Soon
By
–
"AI isn't replacing radiologists" good article Expectation: rapid progress in image recognition AI will delete radiology jobs (e.g. as famously predicted by Geoff Hinton now almost a decade ago). Reality: radiology is doing great and is growing. There are a lot of imo naive
-
Code as King: The Primary Domain for AGI Development
By
–
I was a bit surprised it is less than case than I expected. Code is KING. It’s the primary means of processing digital information – long term I can’t imagine a more important domain for the AGI pilled. And it is highly valuable in the interim too – big TAM @ high salaries.
-
Waving at Future AGI: Human-AI Interaction in 2056
By
–
Anytime someone takes a picture/video that I happen to be in the background of I like to wave at the AGI that sees me 30 years from now