In the beginning, there was BERT. Eventually BERT gave rise to RoBERTa. Then, DeBERTa. Later, ModernBERT. And now, NeoBERT. The new state-of-the-art small-sized encoder:
TECHNOLOGY
-
Optimal Depth-Width Ratio Improves Transformer Performance
By
–
the key insight, i think, is using an optimal depth-to-width ratio for the transformer architecture. and training on good data. a lot of good data. even though NeoBERT has slightly more parameters, it's still faster AND more effective than ModernBERT for long sequences:
-
Jensen Huang at VivaTech Paris 2025 Prepares World for Robots
By
–
🇫🇷 Jensen au Viva Tech Paris 2025
— VISION IA (@vision_ia) 24 juin 2025
Il prépare le monde aux robots.
Une IA qui vous parle. Un robot qui vous regarde. Un GPU qui pense. pic.twitter.com/xk0R4zCqM4Jensen au Viva Tech Paris 2025 Il prépare le monde aux robots. Une IA qui vous parle. Un robot qui vous regarde. Un GPU qui pense.
-
Creative Europe MEDIA Programme Broadens Participation Through Digital Innovation
By
–
Study on broadening participation under the Creative Europe MEDIA Programme | Shaping Europe’s digital future https://
digital-strategy.ec.europa.eu/en/news/study-
broadening-participation-under-creative-europe-media-programme
…
#digitaleu #digital #media #innovation #technology @DigitalEU @elaniazito @ArturHabant @CurieuxExplorer @Shi4Tech @Hana_ElSayyed @Khulood_Almani -
Women in Digital: Shaping Europe’s Digital Future
By
–
Women in Digital | Shaping Europe’s digital future https://
digital-strategy.ec.europa.eu/en/policies/wo
men-digital
…
#digitaleu #digital #europe #Innovation #technology #WomenInTech @DigitalEU @ArturHabant @elaniazito @CurieuxExplorer @Shi4Tech @smaksked @JolaBurnett @lyakovet @mvollmer1 @BetaMoroney @NatSchooler -
Europe’s Digital Decade 2025: Shaping the Future Strategy
By
–
Digital Decade 2025 – Special Eurobarometer | Shaping Europe’s digital future https://
digital-strategy.ec.europa.eu/en/library/dig
ital-decade-2025-special-eurobarometer
…
#digital #europe #digitaldecade #innovation #technology @DigitalEU @ArturHabant @elaniazito @AkwyZ @antgrasso @AnthonyRochand @CurieuxExplorer @Shi4Tech @BetaMoroney @enilev -
AI Real-Time Video Editing Raises Authenticity Concerns
By
–
Vous connaissez Photoshop. Maintenant imaginez Photoshop… pour la vidéo.
— VISION IA (@vision_ia) 24 juin 2025
En temps réel. Avec des calques générés par l’IA.
Ajoutez, supprimez, mixez. Tout devient modulable.
Combien de temps avant qu’on ne sache plus ce qui est vrai ? pic.twitter.com/cCgFiR4kmkVous connaissez Photoshop. Maintenant imaginez Photoshop… pour la vidéo. En temps réel. Avec des calques générés par l’IA. Ajoutez, supprimez, mixez. Tout devient modulable. Combien de temps avant qu’on ne sache plus ce qui est vrai ?
-
13 Must-Have AI Apps to Transform Learning Work and Create
By
–
If your smartphone doesn’t have AI apps, it’s not really smart. Here are 13 must-have AI apps that will transform how you learn, work, and create—right from your pocket
-
Google Redirects Gemini 2.5 Pro Preview Endpoints to GA Model
By
–
Heads up: we will be redirecting "gemini-2.5-pro-05-06" and "gemini-2.5-pro-03-25" endpoints to our GA model gemini-2.5-pro on Jun 26 at 10 AM PST. The latter (03-25) currently points to the (05-06) model. Thanks for being on the 2.5 Pro journey with us, we learned a lot : )
-
US Datacenter Power Demand: 88GW deficit by 2028, nuclear comparison
By
–
I really recommend watching The Geopolitics of AI Infrastructure by @dylan522p > Following the current trend and datacenter power demand, the US will be lacking ~88GW by 2028. For reference, 1 nuclear reactor provides ~1GW. There's a long way to go!