True. SimCLR and BYOL are technically JEA, not JEPA.
But the idea of contrastive SSL for JEA is much older (1993L with updates in 2005 and 2006.
– Signature Verification using a "Siamese" Time Delay Neural Network. Jane Bromley, Isabelle Guyon, Yann LeCun, Eduard Säckinger,
@ylecun
-
SimCLR BYOL JEA Contrastive Learning History Neural Networks
By
–
-
Advocating Self-Supervised Learning in Modern AI
By
–
(Also advocating for self-supervised learning )
-
FAIR-Paris Celebrates Decade of Continuous AI Research Progress
By
–
10 years of FAIR-Paris and progress never slowed down.
-
Robot Safety Through Guardrail Constraints in DINO-WM
By
–
Robot safety through guardrail constraints in the representation space of DINO-WM https://t.co/NY0ogAnhyE
— Yann LeCun (@ylecun) 6 février 2025Robot safety through guardrail constraints in the representation space of DINO-WM
-
Queen Elizabeth Prize for Engineering Award Announced
By
–
Incredibly honored to receive the Queen Elizabeth Prize for Engineering.
-
Autonomous research teams drive better technical innovation
By
–
Big misunderstanding here: my statement was not about individual talents but about *organization* and *management*. The lesson is that small research teams with autonomy, and a long leash, are *empowered* to make the right technical choices and innovate. This is a lesson that
-
DeepSeek Open Source AI Benefits Meta and Entire Community
By
–
It's actually very good for Meta and the rest of the open source AI world.
Since DeepSeek published the techniques and open sources the code, whatever innovation they came up with will make it to other models, including Llama.
Everyone wins.
The only parasites are the ones who -
Meta’s Open Source Strategy and AI Foundation Model Commoditization
By
–
That would be a bull case for Meta, which has 3.3 billion pairs of eyeballs on its various services. The idea that the interface to users matters and the underlying AI foundation model will become commoditized is one reason for Meta's open source strategy. And that's not
-
Open Research and Open Source Drive Tech Innovation Forward
By
–
If open research and open source didn't exist, almost *none* of the innovations we've seen over the last dozen years would have appeared.
No one would be ahead.
Everyone would be held back.