Something I am experimenting with. I copy pasted: 1) the full podcast transcript
2) the bitter lesson blog post
3) my full post above To ChatGPT. The interesting part is you can fork the conversation context to ask any questions and take it in whatever direction with chat:
@karpathy
-
Using ChatGPT to analyze podcast transcripts and AI content
By
–
-
Sutton’s Bitter Lesson Shapes LLM Research Approaches
By
–
Finally had a chance to listen through this pod with Sutton, which was interesting and amusing.
— Andrej Karpathy (@karpathy) 1 octobre 2025
As background, Sutton's "The Bitter Lesson" has become a bit of biblical text in frontier LLM circles. Researchers routinely talk about and ask whether this or that approach or idea… https://t.co/EQ4snNmiTMFinally had a chance to listen through this pod with Sutton, which was interesting and amusing. As background, Sutton's "The Bitter Lesson" has become a bit of biblical text in frontier LLM circles. Researchers routinely talk about and ask whether this or that approach or idea
-
Dyson Spheres: Beyond Reasoning Toward Advanced Technology
By
–
We're not going to reason our way to Dyson spheres. Excited for you and all the best to the team!
-
AI Image Recognition Won’t Replace Radiologists Soon
By
–
"AI isn't replacing radiologists" good article Expectation: rapid progress in image recognition AI will delete radiology jobs (e.g. as famously predicted by Geoff Hinton now almost a decade ago). Reality: radiology is doing great and is growing. There are a lot of imo naive
-
Code as King: The Primary Domain for AGI Development
By
–
I was a bit surprised it is less than case than I expected. Code is KING. It’s the primary means of processing digital information – long term I can’t imagine a more important domain for the AGI pilled. And it is highly valuable in the interim too – big TAM @ high salaries.
-
Waving at Future AGI: Human-AI Interaction in 2056
By
–
Anytime someone takes a picture/video that I happen to be in the background of I like to wave at the AGI that sees me 30 years from now
-
Code Hidden in LLM Layer Activations Demands Apology
By
–
The code was written at layers 22-30 and is stored in the value activations you just can’t read it. I think you owe the LLM an apology.
-
Books as synthetic data generation prompts, not static information
By
–
Most people misunderstand books as data for pertaining when it’s more a set of prompts for synthetic data generation.
-
GSM8K Paper Insights on Mathematical Reasoning in AI
By
–
reminded of this paragraph from gsm8k paper, 2021 🙂
-
Apple’s iPhone Strategy: Continuous Innovation in Consumer Technology
By
–
Actually jason, every iPhone is the best iPhone they have made yet. And this is something only Apple can do.