Imagine a Transformer model without normalization. This is exactly what's proposed in a new paper from Meta, NYU, MIT, and Princeton. The authors found that normalization layers can be replaced with something called Dynamic Tanh (DyT). It looks like this: DyT(x)=γ ∗ tanh(αx)+β.
TECHNOLOGY
-
Computer Vision in Factories for Sustainability at Hampton Court
By
–
Discussing Computer Vision deployed to factories to make them more sustainable, alongside former BP CEO Bernard Looney. At Hampton Court palace in London. Thank you to King Charles and Jennifer Jordan-Saifi for organizing an excellent gathering.
-
Smart Umbrellas Cool Saudi Arabia’s Extreme Heat Challenge
By
–
Turning Heat into Comfort: Smart Innovation in Saudi Arabia ☀️➡️❄️
— Pascal Bornet (@pascal_bornet) 14 mars 2025
In Saudi Arabia’s scorching 50°C heat, a mosque has been transformed into a cool oasis with 250 smart umbrellas—a fusion of technology, design, and climate adaptation.
🔹 Heat-Resistant Materials – Fireproof,… pic.twitter.com/X04cO1Oj8WTurning Heat into Comfort: Smart Innovation in Saudi Arabia In Saudi Arabia’s scorching 50°C heat, a mosque has been transformed into a cool oasis with 250 smart umbrellas—a fusion of technology, design, and climate adaptation. Heat-Resistant Materials – Fireproof,
-
MIT’s Exo 2: High-Performance Programming Language Reduces Code Requirements
By
–
A new programming language from MIT could enable high-performance coding that can compete w/state-of-the-art libraries w/a few hundred lines of code, instead of tens or hundreds of thousands. Called "Exo 2," the approach enables reusable scheduling libraries external to
-
Nvidia Chief Scientist Bill Dally Fireside Chat at GTC
By
–
I'll be doing a fireside chat at GTC with Nvidia chief scientist Bill Dally Tuesday next week.
-
Anthropic API Updates Improve Claude 3.7 Sonnet Performance
By
–
We've made several updates to the Anthropic API that help developers process more requests and reduce token usage with Claude 3.7 Sonnet.
-
Scott Forstall: Key Figure in Tech Industry History
By
–
In case you’ve always wondered who Scott Forstall is and why he always comes up at times like this, here you go
-
SAS Drives Climate Innovation Through Sustainability Technology
By
–
🌱 Climate change is not a distant threat—it's happening now. From rising temperatures to shrinking ice caps, our 🌎 needs action today. See how Southern States Energy Board is using SAS to drive innovation, champion sustainability & protect our future. https://t.co/u0eYnuMnXz pic.twitter.com/HOQcyY1mN6
— SAS Software (@SASsoftware) 13 mars 2025Climate change is not a distant threat—it's happening now. From rising temperatures to shrinking ice caps, our needs action today. See how Southern States Energy Board is using SAS to drive innovation, champion sustainability & protect our future. http://
2.sas.com/6016L7KME -
Gemini Robotics: Advanced Vision-Language-Action Model for Robotics
By
–
Gemini Robotics is SOTA.
— Linus ✦ Ekenstam (@LinusEkenstam) 13 mars 2025
It's a Generalist Vision-Language-Action Model. Yeah thats a mouthful
It's extremely capable, enabling dexterous, steerable and general robotics control. We live in the future.pic.twitter.com/bfefFm8fbKGemini Robotics is SOTA. It's a Generalist Vision-Language-Action Model. Yeah thats a mouthful It's extremely capable, enabling dexterous, steerable and general robotics control. We live in the future.
-
Deep Real World Understanding Critical for AI Technology Success
By
–
3. Deep real world understanding This is paramount for this technology to work otherwise it would not work