People keep sending me this clip of @iamjohnoliver using my tweet as evidence that AI models don’t work well. Just to clear up any confusion, with respect, the tweet was a) taken way out of context and b) extremely outdated. The model in question (4o) is multiple generations
@mattshumer_
-
Agent-S: One-Click AI Agent Setup with 1000+ App Integration
By
–
This blew up… check out https://
agent-s.app (one-click setup, insanely powerful agent with access to 1000+ apps out of the box) -
Intelligence per Token: Measuring AI Model Efficiency
By
–
With all this talk about "intelligence per token"… well…
-
Service Quality Degradation During Rapid Business Growth
By
–
One thing I've noticed with the good ones is that service quality drops over time. The good ones tend to get tons of business + grow quick, and then they scale and things just get worse and worse.
-
Opus 4.7 Performance Issues: Major Regression Compared to GPT-4o
By
–
i'm a few days late to realizing this but: wow, opus 4.7 is god awful like so, so bad it's making mistakes on things i'd expect gpt-4o to handle cleanly there's got to be some explanation, right?
-
Claude 5.5 Outperforms Opus Beyond Frontend Work Analysis
By
–
Having used both extensively, this doesn’t track with my experience. Aside from frontend work, 5.5 is leaps and bounds ahead of Opus. I don’t think this benchmark tells us anything useful anymore.
-
AI Models Reaching Excellence in Code, Struggling Elsewhere
By
–
It's not "meh", and it's not plateauing. I think we're just reaching a point where, for the things the models were already good at (i.e. code), they are becoming absolutely excellent, and it's hard to tell the difference between releases. And for things that they're not yet good
-
New AI Model Excels at Hard Tasks, Uses Fewer Tokens
By
–
It's an incredible model. The problem is, the previous models were incredible too. For most tasks, it won't feel very different. But for hard tasks, it's significantly better. It also uses fewer tokens, so even though it is priced higher per token, you might end up spending
-
GPT-5.5 Review: Massive Leap Forward but Major Regression
By
–
I’ve been using GPT-5.5 for the last few weeks. It’s a MASSIVE leap forward. But the weird thing is: for 99% of users, it probably won’t matter. And there's one BIG, incredibly frustrating regression. Read more in my review: