Adaptive optimizers like Adam track the square of the gradient, but what they receive as the gradient is actually the sum of the gradients across the batch. It seems likely that better results at different hyper parameters could be obtained if backward passes emitted true grad^2.
INNOVATION
-
Stay small nimble more joy startup philosophy
By
–
Been there, can relate so much. Stay small and nimble, more joy.
-
Neural Operators and AI for Science Talk at MIT IAIFI
By
–
It was great visiting @mit @iaifi_news and give a talk about neural operators and AI for science. You can find my talk here https://
youtu.be/RR5-mYQOb7E?t=
1208
… -
NVIDIA Accelerates 5G Cloud Edge Transformation at RedHat
By
–
Join NVIDIAs Justin Boitano at RedHat #Open5G2022 to learn about accelerated #5G, cloud, and #edge transformations. Register now: https://
nvda.ws/3Wjz8fL -
LLMs Self-Improve: New State-of-the-Art Reasoning Capabilities
By
–
We recently read ‘Large Language Models Can Self-Improve,’ which demonstrates how to improve the general reasoning ability of multi-billion parameter models and achieve state-of-the-art performance. Have you read it? Check it out and let us know your thoughts! #ML #AI #LLM
-
Groq and Entanglement AI showcase quantum cybersecurity innovation at SC22
By
–
Enabling innovation for our customers, like being the bridge to quantum, is what @GroqInc does. Curious to learn more about @entanglement_ai
's cybersecurity anomaly detection capability? They'll join us at #SC22 so stop by booth 3047 & read the report http://
groq.link/csadpr. -
AI Solution for TB Patient Loss-to-Follow-Up Prediction Workshop
By
–
On 1st November, we successfully conducted a workshop with 24 District TB Officers in Mumbai to finalise protocol study designs and field interventions to pilot our AI solution for the prediction of loss to follow-up and mortality in TB patients. @PATHtweets @USAID
-
Wolfspeed Secures Major Financing for Silicon Carbide Growth
By
–
Wolfspeed makes its case for a ton of financing Silicon carbide “may be the largest single growth of any technology in the history of semiconductors,” says Gregg Lowe, Wolfspeed’s CEO. // $WOLF $ON https://
thetechnologyletter.com/the-posts/wolf
speed-makes-its-case-for-a-ton-of-financing
… -
Elon Musk’s next controversial moment in AI development
By
–
I wonder how long it’ll take until Elon has his 00:29 moment. https://
youtu.be/OXqkTzyifJQ