Agree that this is an important capability hole right now (I saw you push back on it a few times in the pod and I also didn't find the answers too satisfying). I like to talk explain it as LLMs are a bit like a coworker with Anterograde amnesia – they don't consolidate or build
@karpathy
-
Veo 3 Video Generation: Audio Impact and Bandwidth Considerations
By
–
Very impressed with Veo 3 and all the things people are finding on r/aivideo etc. Makes a big difference qualitatively when you add audio.
— Andrej Karpathy (@karpathy) 2 juin 2025
There are a few macro aspects to video generation that may not be fully appreciated:
1. Video is the highest bandwidth input to brain. Not… https://t.co/zVDM1yyzXUVery impressed with Veo 3 and all the things people are finding on r/aivideo etc. Makes a big difference qualitatively when you add audio. There are a few macro aspects to video generation that may not be fully appreciated: 1. is the highest bandwidth input to brain. Not
-
Choosing Between o3 and 4o Based on Task Importance
By
–
Got it! I think I make the decision of whether something is important (and I'm willing to wait) or not that important (and I just want to get a fast sense) and that basically determines if I go to o3 or 4o. It's conceptually easy to just make a binary decision. I'll try it more!
-
API pricing clarification for pay-as-you-go models
By
–
ah ok, in API setting where it's more pay-as-you go this makes sense ty for noting!
-
Karpathy Endorses Perplexity for Search and Quick Summaries
By
–
I really like Perplexity and use it for anything "search-like", though other LLM providers now include search. It's fast and works great, and is also very useful for quick summaries of whatever trending topics there are. (I'm an investor fyi, but <3 for reals).
-
O3 Reasoning Model Superiority for Important Tasks
By
–
An attempt to explain (current) ChatGPT versions. I still run into many, many people who don't know that:
– o3 is the obvious best thing for important/hard things. It is a reasoning model that is much stronger than 4o and if you are using ChatGPT professionally and not using o3 -
AI Production Consumption Ratio Expected to Increase Significantly
By
–
could definitely see it; we might see the production : consumption ratio lift a lot as a result of gen ai, bullish!
-
Llama 1B Inference Optimized in Single CUDA Kernel
By
–
So so so cool. Llama 1B batch one inference in one single CUDA kernel, deleting synchronization boundaries imposed by breaking the computation into a series of kernels called in sequence. The *optimal* orchestration of compute and memory is only achievable in this way.
-
AI-free zones at parties as a safe space solution
By
–
Alternative solution I am fond of is parties should have a designated “no AI” circle drawn on the floor. A little safe space.
-
Silent Bugs: The Deep Learning Horror of Misconfigured Parameters
By
–
Deep Learning horror genre That fear of a kwarg that isn’t set right, not erroring, only silently making your results slightly worse.