A talk on Self-Supervised Learning
@ylecun
-
Can Humans Beat AI Chess Engines Today?
By
–
Humans smarter than chess-playing toys?
Can you beat a $30 chess-playing toy at chess? -
Reviewer Accountability and Open Scientific Review Systems
By
–
The reviewers are responsible for the reviews regardless of the tools they choose to use.
The problem is accountability.
That's why I've been an advocate of open reviews, and of removing the exclusive relationship between papers and reviews. Speaking of which, the destruction by -
Softmax vs MSE: Contrastive Loss Function Design
By
–
No good reason, other than the fact that softmax puts a big weight on nearby contrastive samples.
MSE works just fine. But the contrastive should not be the one you write.
First, it should be lower bounded, something like Relu(m-dist(xi,xi')), which pushes samples away by at -
Srinivasa Varadhan Biography Abel Prize Mathematics
By
–
True story: https://
abelprize.no/sites/default/
files/2021-04/Biography_en_SrinivasaS.R.Varadhan_2007.pdf
… -
Five Ways to Act Deluded Stupid Ineffective or Evil
By
–
"Five Ways to Act Deluded, Stupid, Ineffective, or Evil"
-
NSF Funding Decisions and DEI Policy Impact Debate
By
–
Oh, don't be ridiculous. You know perfectly well that a tiny portion of NSF funding decisions would have been different, had no one paid any attention to DEI.
-
NSF Budget DEI Impact and Funding Cut Justification
By
–
Just tell us: how much of the NSF budget do you think is affected by DEI considerations, let alone misdirected because of DEI?
Do you have a number?
Is it 1%, 5%, 10%, 25%?
Does it justify cutting the NSF budget by 50%? -
Is Scientific Research Politically Captured Debate
By
–
You're seriously telling us that research in computer science, engineering, physics, chemistry, etc is "politically captured"? What world do you live in?
-
Meta-FAIR: The Open Source Foundation of AI Industry
By
–
Meta already has the most open research operation in the industry.
It's called Meta-FAIR.
I started it 11.5 years ago.
There are 1400 open source repos from Meta, most of them for AI research.
Without FAIR, there would be no AI industry: it's entirely built on FAIR's open source