Gradient descent is a powerful tool for optimization spaces that verify the manifold hypothesis, but the space of reasoning is discrete and combinatorial. GD fails in cliff-like landscapes where a single discrete change (a logical step) alters the entire outcome. Unless…???
@fchollet
-
General Intelligence Emerges from Adaptation to Novel Situations
By
–
What's remarkable is that general intelligence emerges evolutionarily from the simple goal "you need to survive/succeed through a series of ever-novel, often adversarial situations" General intelligence is a situated process of efficient adaptation to novelty
-
Universal Intelligence and Scientific Understanding of Natural Laws
By
–
Because our universe follows stable laws, a sufficiently general intelligent system adapted to it, like human-driven science, can eventually model any phenomenon within it. Human intelligence may not be "universal" in the mathematical sense (see No Free Lunch theorem), but we
-
Gemini 3 Flash establishes new ARC-AGI-2 efficiency frontier
By
–
Gemini 3 Flash across different test-time compute levels (green line below) represents a new score/cost Pareto frontier on ARC-AGI-2. Congrats to @demishassabis and @sundarpichai on the launch!
-
General Intelligence Differs from Artificial Human Mind
By
–
To note, general intelligence is only one part of what makes us human, so a digital general intelligence is quite different from an artificial human mind.
-
Implementing General Human Intelligence in Digital Form
By
–
Humans are generally intelligent, and general intelligence is something that we can implement in digital form. Which is exactly what we're currently doing at @ndea
. -
Google’s Unexpected Dominance at the Tech Party
By
–
Satya invited Google to the party to "make it dance" But then it turned out Google was a level-99 kinesthetic savant that mastered breakdancing on the spot and stole the whole show
-
Black Friday: Deep Learning with Python 3rd Edition 50% Off
By
–
Black Friday deal for Deep Learning with Python (3rd edition): 50% off, just today. Go buy it:
-
Pre-ChatGPT perspective remains valid today
By
–
That was my pre-ChatGPT take. It is still true today.
-
Scaling improvements will continue despite missing critical elements
By
–
One point I made that didn’t come across:
– Scaling the current thing will keep leading to improvements. In particular, it won’t stall.
– But something important will continue to be missing. x.com/slow_developer…