AlphaZero *does* perform planning.
That's done through MCTS, using a ConvNet to propose good moves and another one to evaluate positions.
The amount of time spent exploring the tree is potentially infinite.
That's reasoning and planning.
RL is used to train those nets.
@ylecun
-
AlphaZero Planning Through MCTS and Neural Networks
By
–
-
Inaugural Chair Named for Jacob Schwartz Professorship Computer Science
By
–
I am extremely honored and grateful to be named the inaugural chair of the Courant Institute's Jacob T. Schwartz Chaired Professorship in Computer Science. Jack Schwartz co-founded the NYU computer science department in the late 1960s, as a spin-off of the Courant Institute of
-
Auto-Regressive LLMs Limited Reasoning Cannot Be Fixed by Scaling
By
–
Anyone who thinks Auto-Regressive LLMs are getting close to human-level AI, or merely need to be scaled up to get there, *must* read this. AR-LLMs have very limited reasoning and planning abilities.
This will not be fixed by making them bigger and training them on more data. -
OpenAI talent exodus fuels AI startup competition and innovation
By
–
You misunderstood.
OpenAI can and does absorb advancements from the open community (they use transformers from Google and PyTorch from Meta).
But their employees don't stay there forever. For example, Anthropic was founded by OpenAI escapees.
Some folks left to go back to -
Open Research Communities Drive Innovation and Success
By
–
Which is why open research communities wins.
-
Military R&D Lags Behind Due to Closed Innovation Models
By
–
Yup.
And that's why military R&D is years behind.
Closed R&D organisations inevitably trail behind open ones because the set of potential contributors is smaller and less diverse. -
Closed Frontier Labs Cannot Maintain Competitive Advantage Long Term
By
–
Major fallacy here: "closed frontier labs" can't possibly stay simultaneously "closed" and "frontier" for very long.
They must either open up or fall behind.
In any case, they will lose whatever advance they think they have.
Why? Because people move around and ideas get around. -
Democracy Essential for Beneficial Technological Progress
By
–
That's why we have democracy.
If you don't believe that democracy is effective, you may have doubts that technological progress will be for the greater good.
Non democratic societies have bigger problems than technology. -
Technology’s Impact on Human Evolution and Biological Transformation
By
–
1. I didn't write what you are quoting me as having written.
2. Humans from 40,000 years ago would probably not see us as having the same form as them.
3. Technology has already transformed humans and will continue to do so (e.g. our teeth are what they are because we have knives -
Techno-Optimism: Humanism and Active Technology Optimism
By
–
Excellent piece by @Noahpinion on techno-optimism.
So many good points. Like Noah, I'm a humanist who subscribes to both Positive and Normative forms of Active Techno-Optimism. Quote: "Techno-optimism is thus much more than an argument about the institutions of today or the