AlphaGo = Convnets + Search
GPT-5 = GPT-4 + Search
RESEARCH
-
AlphaGo and GPT-5: The Role of Search in AI Systems
By
–
-
Better reasoning reduces AI data requirements exponentially
By
–
Better reasoning exponentially reduces the amount of data you need.
-
Quality reasoning matters more than data quantity
By
–
We don't need more data, we need better reasoning.
-
Robotics Progress Slower Than Data Suggests, AGI Decade Away
By
–
Even with unlimited data, progress in robotics is 10X slower because of the infinite things that continuously go wrong. So even in an ideal scenario we're more than a decade from AGI.
-
Founding Fathers of AI Had Greater Intellectual Caliber Than Today’s Hackers
By
–
For all their mistakes, the founding fathers of AI had an intellectual caliber that today's hackers don't.
-
Weak Supervision Revolutionizing AI Training Data Generation
By
–
Want to see the future of weak supervision in AI? Join esteemed professors and researchers from Brown University, University of Wisconsin-Madison, and Stanford University shed light on how weak supervision is revolutionizing the way we generate AI training sets. This panel
-
Understanding Giant Tensors and Writing Goodhart-Proof Objectives
By
–
It doesn't need to be representing new physics, for us to have trouble understanding what the giant inscrutable tensors mean — or writing airtight Goodhart-proof objectives that operate over them, a much higher requirement of proficiency than current interpretability efforts.
-
Engineer’s Respect and Admiration for the Human Brain
By
–
As an engineer, I have nothing but respect and admiration for the human brain.
-
Positional Encoding: Essential Beyond Attention in Transformers
By
–
Attention is not all you need. Without positional encoding, a transformer would treat a context as a bag of words.