Generating candidates is now easy compared to back then. An AI can generate: 100 prompt variants 50 code changes 20 tool-routing ideas 10 eval rewrites 5 new workflows
The question is not “can it come up with changes?”
The question is “which changes are actually better?”
RESEARCH
-
AI Generation Quality Assessment Beyond Candidate Quantity
By
–
-
Verifiers: The Key to Evaluating AI Model Performance
By
–
That is where the verifier comes in. A verifier is whatever checks the work. It can be: test results human review a simulator a benchmark real user outcomes a second model judging the first model
The verifier is the thing that decides what gets kept. -
Karpathy’s AutoResearch: 700 Experiments, 20 Key Optimizations Found
By
–
Karpathy’s AutoResearch made this concrete. One markdown prompt. 630 lines of training code. One GPU. 2 days.
It ran 700 experiments and found 20 training optimizations.
Most people was impressed by on the 700 experiments.
But what most people missed out is what decided which 20 -
The Verification Problem in AI Self-Improvement Systems
By
–
AI agents can now generate endless ways to improve themselves. New prompts. New code. New plans. New experiments. New tool calls.
That is not the bottleneck anymore.
The bottleneck is the verifier.
How do you know the new version is actually better? -
Self-Improvement Loops: How AI Systems Learn Through Feedback
By
–
First, what’s actually happening. A self-improvement loop is simple: try a change test the change keep what helped throw away what did not repeat
That’s it.
The system is not magically becoming intelligent.
It is running a feedback loop. -
Hinton’s 2016 radiologist prediction versus actual data outcomes
By
–
“we might as well stop training radiologists” Geoff Hinton, 2016, vs the actual data, via Torsten Slok at Apollo
-
Innovation Diffusion Knowledge Shapes AI Adoption Timeline Expectations
By
–
The less you know about the diffusion of innovations, the sooner you think AI will take over.
-
Universe as Permutations: Beyond Physical Movement
By
–
The universe is not made of things that move. It's made of permutations, some of which look like things that move.
-
The 2020s Mirror 1970s but at Accelerated Speed
By
–
The 2020s are like the 1970s, except everything happens a lot faster. https://t.co/vxmZ2xazRi
— Pedro Domingos (@pmddomingos) 29 avril 2026The 2020s are like the 1970s, except everything happens a lot faster.
-
Tandem Voice AI Architecture Enables Speaking While Thinking
By
–
For years, voice AI has been stuck in a rigid loop: think, then speak. But real human conversation is messy, overlapping, and asynchronous.
— hardmaru (@hardmaru) 29 avril 2026
In our new #ICASSP2026 work, we built a tandem architecture that shifts the paradigm to “speak while thinking.” A fast speech model starts… https://t.co/gyRFlqDSUjFor years, voice AI has been stuck in a rigid loop: think, then speak. But real human conversation is messy, overlapping, and asynchronous. In our new #ICASSP2026 work, we built a tandem architecture that shifts the paradigm to “speak while thinking.” A fast speech model starts