co-sign. a very handy mental framework for what kinds of learning transformers do well today, and why it runs into limitations. when @ankit2119 and i wrote about the need for adversarial world models earlier this year, we were describing a couple of the functions of these rungs
RESEARCH
-
I²B-LPO: Branching AI Reasoning at Confusion Points
By
–
Are your AI models stuck in a rut, repeating the same narrow reasoning? Alibaba's DAMO Academy and partners (USTC, SJTU, Zhejiang, Northeastern) introduce I²B-LPO. Instead of randomly tweaking words, it branches reasoning at key confusion points and uses an information
-
Free online book covers LLM concepts for all backgrounds
By
–
UNBELIEVABLE RESOURCE The bible for understanding LLMs is NOW AVAILABLE online to read (FOR FREE) Covers all the concepts below, no experience needed and anyone from any background can understand it – Tokens / Tokenizers
– Transformers
– Attention
– KV Cache
– Prefill vs -
LLM Ideation: Coherence vs. Availability Trade-off
By
–
The key distinction here is worth sitting with: Standard LLM ideation can be coherent but available. Random recombination can be unavailable but incoherent. The target is the rare quadrant: coherent but unavailable. That is where this paper gets interesting.
-
Paper highlights rare ‘coherent but unavailable’ LLM outputs
By
–
The key distinction here is worth sitting with: Standard LLM ideation can be coherent but available. Random recombination can be unavailable but incoherent. The target is the rare quadrant: coherent but unavailable. That is where this paper gets interesting.
-
New preprint explores the frontier of what is thinkable
By
–
Science has a hidden frontier. Not the frontier of what is true. The frontier of what is thinkable. A remarkable new preprint by Alejandro H. Artiles, Martin Weiss, Levin Brinkmann, Iyad Rahwan, Bernhard Schölkopf, Christopher Pal, Hugo Larochelle, Anirudh Goyal, and Nasim
-
Demis says Singularity few years away, AGI transformative technology
By
–
Demis says the Singularity may now be only a few years away, potentially set in motion by the arrival of true AGI.
— Chubby♨️ (@kimmonismus) 23 mai 2026
"Its being so transformative, it will be the most important technology ever" pic.twitter.com/5VOBLc8Eh8Demis says the Singularity may now be only a few years away, potentially set in motion by the arrival of true AGI. "Its being so transformative, it will be the most important technology ever"
-
LLMs should aid human learning, creativity, and experimentation
By
–
I feel that the trend towards training models to autonomously go off and try to do everything themselves is anti-human. We should, IMO, be training LLMs to support humans in their learning, creativity, and iterative experimentation.
-
Claude MD File: Top GitHub Repo Uses Karpathy’s 4 LLM Principles for AI Control
By
–
DID YOU KNOW THE #1 GITHUB TRENDING REPO (146K+ STARS) IS LITERALLY JUST A CLAUDE MD FILE? It uses @karpathy
's 4 LLM principles to keep AI in check: → Seek clarity: Always ask before making assumptions.
→ Stay minimal: Avoid bloat and keep things simple.
→ Edit -
LLM trained on whole Internet is inefficient for language understanding
By
–
Learning an LLM from the whole Internet is a spectacularly inefficient way to understand language.