Okay so I didn't super expect the results of the GPT4 vs. GPT4.5 poll from earlier today , of this thread: https://
x.com/karpathy/statu
s/1895213020982472863
… Question 1: GPT4.5 is A; 56% of people prefer it.
Question 2: GPT4.5 is B; 43% of people prefer it.
Question 3: GPT4.5 is A; 35% of people
@karpathy
-
GPT4 vs GPT4.5 Poll Results Surprise Karpathy
By
–
-
How I Use LLMs: Practical Guide to the LLM Ecosystem
By
–
New 2h11m YouTube video: How I Use LLMs This video continues my general audience series. The last one focused on how LLMs are trained, so I wanted to follow up with a more practical guide of the entire LLM ecosystem, including lots of examples of use in my own life. Chapters
-
GPT 4.5 Release: Measuring AI Improvement Through Scaling
By
–
GPT 4.5 + interactive comparison 🙂 Today marks the release of GPT4.5 by OpenAI. I've been looking forward to this for ~2 years, ever since GPT4 was released, because this release offers a qualitative measurement of the slope of improvement you get out of scaling pretraining
-
First Large Diffusion-Based LLM: Alternative to Autoregressive Approach
By
–
This is interesting as a first large diffusion-based LLM.
— Andrej Karpathy (@karpathy) 27 février 2025
Most of the LLMs you've been seeing are ~clones as far as the core modeling approach goes. They're all trained "autoregressively", i.e. predicting tokens from left to right. Diffusion is different – it doesn't go left to… https://t.co/I0gnRKkh9kThis is interesting as a first large diffusion-based LLM. Most of the LLMs you've been seeing are ~clones as far as the core modeling approach goes. They're all trained "autoregressively", i.e. predicting tokens from left to right. Diffusion is different – it doesn't go left to
-
LLMs Becoming as Cheap and Accessible as Five Dollar Uber Rides
By
–
We are in the era of $5 Uber rides anywhere across San Francisco but for LLMs weee
-
Voice Quality Regression in AI Assistant After Updates
By
–
They iterated on it a bit, e.g. custom instructions and the ability to join the podcast, but I think overall agree. I actually used it again this morning after a while and it felt a bit regressed, even? The woman's voice esp sounds slightly more dead / less interested, or
-
Agency More Powerful and Scarce Than Intelligence
By
–
Agency > Intelligence I had this intuitively wrong for decades, I think due to a pervasive cultural veneration of intelligence, various entertainment/media, obsession with IQ etc. Agency is significantly more powerful and significantly more scarce. Are you hiring for agency? Are
-
Fine-tuning’s Surprising Power: Knowledge Retention Through Style Change
By
–
Wow it really has been that long 😐
The big thing I didn’t realize is that an assistant was just a finetune away. That is the surprising thing I was really missing. I still find it surprising today, that you can just change the style so dramatically but retain the knowledge. -
Dataset difficulty balance: avoiding trivial and impossible problems
By
–
Great question it doesn’t. You hope there are always enough problems in your dataset that are *just right* hard – not trivial and not impossible. If not, it won’t work.