Anyone who thinks Auto-Regressive LLMs are getting close to human-level AI, or merely need to be scaled up to get there, *must* read this. AR-LLMs have very limited reasoning and planning abilities.
This will not be fixed by making them bigger and training them on more data.
@ylecun
-
Auto-Regressive LLMs Limited Reasoning Cannot Be Fixed by Scaling
By
–
-
OpenAI talent exodus fuels AI startup competition and innovation
By
–
You misunderstood.
OpenAI can and does absorb advancements from the open community (they use transformers from Google and PyTorch from Meta).
But their employees don't stay there forever. For example, Anthropic was founded by OpenAI escapees.
Some folks left to go back to -
Open Research Communities Drive Innovation and Success
By
–
Which is why open research communities wins.
-
Military R&D Lags Behind Due to Closed Innovation Models
By
–
Yup.
And that's why military R&D is years behind.
Closed R&D organisations inevitably trail behind open ones because the set of potential contributors is smaller and less diverse. -
Closed Frontier Labs Cannot Maintain Competitive Advantage Long Term
By
–
Major fallacy here: "closed frontier labs" can't possibly stay simultaneously "closed" and "frontier" for very long.
They must either open up or fall behind.
In any case, they will lose whatever advance they think they have.
Why? Because people move around and ideas get around. -
Democracy Essential for Beneficial Technological Progress
By
–
That's why we have democracy.
If you don't believe that democracy is effective, you may have doubts that technological progress will be for the greater good.
Non democratic societies have bigger problems than technology. -
Technology’s Impact on Human Evolution and Biological Transformation
By
–
1. I didn't write what you are quoting me as having written.
2. Humans from 40,000 years ago would probably not see us as having the same form as them.
3. Technology has already transformed humans and will continue to do so (e.g. our teeth are what they are because we have knives -
Techno-Optimism: Humanism and Active Technology Optimism
By
–
Excellent piece by @Noahpinion on techno-optimism.
So many good points. Like Noah, I'm a humanist who subscribes to both Positive and Normative forms of Active Techno-Optimism. Quote: "Techno-optimism is thus much more than an argument about the institutions of today or the -
Government and Big Business Role in Technological Innovation
By
–
That's an excellent piece, Noah.
So many good points. I particularly like this bit:
"So anyone who thinks that technology is pushed forward solely by scrappy inventors in their garages, while government and big business merely parasitizes off of their labors, is deeply wrong. -
Collaborating with Young Talented AI Professionals
By
–
Working with young and talented collaborators.