And they have been proven right. So far, no scaling limits, as bigger models are still better. When I wrote that GPT-4 was still the best model ever. I don’t understand the argument you are trying to make here, or why you brought up this random tweet as a gotcha? Seriously.
RESEARCH
-

OpenAI 10x Scale Delivers 10-30% Performance Improvements
By
–
OpenAI’s graphs? 10x scale leads to 10-30% improvements.
-
Scaling Limitations and AI Labs’ Path to AGI
By
–
It feels dishonest to call it retconning when even the AI labs have been clear about diminishing returns. Some of them think that it won’t matter because they can still scale fast enough to AGI that the curve isn’t relevant. Or that other approaches like RL will boost scale.
-

Scaling Laws and Diminishing Returns in AI Development
By
–
I am not a good strawman here for you to gotcha quote tweet. I never predicted imminent AGI, but more importantly the entire point of the scaling law is diminishing returns to scale. Its a logarithmic curve, as has been known. That doesn’t mean you don’t get gains from scaling.
-
Sutton’s Bitter Lesson: Scaling Computation in Reinforcement Learning
By
–
The Bitter Lesson "Search and learning are general purpose methods that continue to scale with increased computation, even as the available computation becomes very great." — Richard Sutton Rich Sutton: http://
incompleteideas.net/IncIdeas/Bitte
rLesson.html
… #ReinforcementLearning -
Data Collection and Machine Learning Revolution Reshaping Human World
By
–
Abstract: Information technology is in the midst of a revolution in which omnipresent data collection and machine learning are impacting the human world as never before. The word "intelligence" is being used as a North Star for the development of this technology, with human
-
Michael Jordan on Collectivist Economic Perspective on AI
By
–
New position paper from BAIR faculty Professor Michael I. Jordan: "A Collectivist, Economic Perspective on AI"
-
LFM2 Model Now Available on LM Studio Beta
By
–
LFM2 is now available on @lmstudio 🎉
— Maxime Labonne @ ICLR (@maximelabonne) 13 juillet 2025
You can play with it today using the beta channel.
I noticed that other small models often struggle to provide relevant answers within a structured output. We trained LFM2 on so much structured outputs that it doesn't mind at all. pic.twitter.com/fn1egMXsZBLFM2 is now available on @lmstudio You can play with it today using the beta channel. I noticed that other small models often struggle to provide relevant answers within a structured output. We trained LFM2 on so much structured outputs that it doesn't mind at all.
-
LLM Scaling to AGI: Multiple Pathways and Potential Roadblocks
By
–
None of this means that there could not be roadblocks or that LLMs will scale to AGI – we have no idea – but there appear to be multiple options going forward.
-
Scaling Laws and Tool Use Driving AI Progress Forward
By
–
Grok 4 suggests that scaling still works (with the diminishing returns predicted by the scaling law), and that tool use can unlock performance gains. Kimi suggests there continues to be big opportunities from improvements in methods (Muon, etc.). Lots of paths for AI right now.