There is a ton of fascinating and inspiring work by brilliant researchers at CogSci 2025, but the bulk of the field has been killed by the rapid advances of AI and just does not know it yet. #bitterlesson
RESEARCH
-
Early Math Learning Critical for AI and Cognitive Development
By
–
Because you cannot catch up past your formative years. Just like you likely won’t become a great pianist or soccer player if you start in your twenties, you have to integrate mathematical ability deeply by starting early. Also, your raw brain power starts declining past 21.
-
GML-4.5 Gravitational Wave Particle Grid Visualization
By
–
4. GML-4.5 by @Zai_org
— Shubham Saboo (@Saboo_Shubham_) 2 août 2025
3D grid of particles animated by a passing gravitational wave. pic.twitter.com/qB118mIJe34. GML-4.5 by @Zai_org 3D grid of particles animated by a passing gravitational wave.
-
DeepSeek R1 Demonstrates Advanced AI Reasoning Capabilities
By
–
3. DeepSeek R1 by @deepseek_ai
— Shubham Saboo (@Saboo_Shubham_) 2 août 2025
3D grid of particles animated by a passing gravitational wave. pic.twitter.com/x4OpSBQEgX3. DeepSeek R1 by @deepseek_ai 3D grid of particles animated by a passing gravitational wave.
-

DeepThink vs O3 Pro: Dramatic Performance Gap Analysis
By
–
not enough people are talking about the delta between the parallel thinking uplifts of oai vs gdm AIME
o3 pro: +3% (from 90->93 on 2024)
deep think: +11.2% (from 88->99.2 on 2025) Knowledge
o3 pro: +3% (on GPQA)
deep think: +13.2% (on HLE) Coding
o3 pro: +9.1% (on Codeforces -
LLM News Updates: Reverse-Engineering Latest Developments
By
–
… or if you want my free but MUCH longer and more frequent newsletter I just sent out out too – here's the latest edition, covering just the last three days of LLM-related news https://
simonw.substack.com/p/reverse-engi
neering-some-updates
… -
We Got 140,000 Tokens Instead of Flying Cars
By
–
We wanted flying cars, instead we got 140,000 tokens.
-
Residual Stream as Working Memory in Neural Networks
By
–
The residual stream is what psychologists call working memory.
-
Atoms as Local Maxima of Event Frequency in Space
By
–
An atom is just a local maximum of event frequency in space.