Better reasoning exponentially reduces the amount of data you need.
@pmddomingos
-
Quality reasoning matters more than data quantity
By
–
We don't need more data, we need better reasoning.
-
Robotics Progress Slower Than Data Suggests, AGI Decade Away
By
–
Even with unlimited data, progress in robotics is 10X slower because of the infinite things that continuously go wrong. So even in an ideal scenario we're more than a decade from AGI.
-
Founding Fathers of AI Had Greater Intellectual Caliber Than Today’s Hackers
By
–
For all their mistakes, the founding fathers of AI had an intellectual caliber that today's hackers don't.
-
Engineer’s Respect and Admiration for the Human Brain
By
–
As an engineer, I have nothing but respect and admiration for the human brain.
-
Nvidia shareholders emerge as biggest AI revolution winners
By
–
The biggest winners of the AI revolution so far are Nvidia shareholders.
-
Positional Encoding: Essential Beyond Attention in Transformers
By
–
Attention is not all you need. Without positional encoding, a transformer would treat a context as a bag of words.
-
LLM’s Primary Limitation: Unable to Distinguish Facts
By
–
The #1 limitation of an LLM is that it doesn't know what a fact is.
-
AI Regulation Critics Should Face Scrutiny Instead
By
–
AI doesn't need reined in. The people trying to rein in AI need reined in.