What proves that the generative approach is wrong is oodles of empirical results showing the superiority of joint embedding architectures over generative ones (based on reconstruction) for natural sensor data (e.g. images and video). It's not just for self-supervised learning
@ylecun
-
LLMs Useful But Limited for Robot-Rich Future Success
By
–
1. I never said LLMs were not useful. They are, particularly with all the bells and whistles that are being added to them. I use them.
2. A robot-rich future can't be built with AIs that don't understand the physical world and don't anticipate the consequences of their actions. -
AI Saves Lives: Medical Imaging and Vehicle Safety Systems
By
–
Actually, AI already saves lives. In several countries, mammograms are examined by AI and radiologists. Reliability is improved. In the EU, every car sold must be equipped with Automatic Emergency Braking Systems. That's AI. They reduce frontal collisions by 40%.
Modern MRI -
Reagan’s Policies: Labor Productivity Decoupling and Media Deregulation
By
–
The Great Decoupling of labor productivity and median income with Reagan's tax cuts in the early 1980s. Also Reagan's abandonment of the FCC Fairness Doctrine, which opened the door to shameless propaganda on TV and radio.
-
Meta’s JEPA Strategy Shift: LLM Focus Over World Models
By
–
Right. Except that Mark Z, @boztank and others in the leadership were always supportive of the JEPA / World Models project as a long-term bet.
But the AI strategy of company became more LLM-pilled and short-term focused.
And many of the applications of JEPA/WM are in industrial -
Softmax Creator Regrets Terminology Choice, Suggests Softargmax
By
–
John Bridle himself, the man who coined the term "softmax", says that he should have called it "softargmax"
-
Probability of AI doom: agency and collective responsibility
By
–
I didn't say p(doom) was zero. I said:
1. All estimates are pulled out of thin air
2. It makes little sense to attribute a probability to an event on which we have agency. If you do so, it's more of a statement about our collective ability to do the right thing than about the -
AI to Add 0.6% Annual GDP Growth Over Next Decade
By
–
They all predict around 0.6% additional growth PER YEAR over the next decade due to AI.
In other words, if GDP growth without AI was going to be 2.5% per year on average, it will now be about 3.1% per year. The compound growth over 10 years will be 36% instead of 28%.
The GDP -
Leading AI Researcher Secures Historic Seed Round at AMI Labs
By
–
You're right, I don't have a job. I have TWO jobs:
1. Jacob T Schwartz Professor at the NYU Courant Institute. 2. Executive Chairman at AMI Labs, for which we just raise the biggest seed round in history outside the US. -
AI Leaders Misunderstand Technological Impact on Labor
By
–
I love Geoff.
But he understands even less than Dario about the effects of technological revolutions on the labor market.
Again, don't listen to AI scientists, as brilliant as they might be, and even less to AI CEOs, as successful as they might be, for questions of labor