And an overview of how ZerO initialization can overcome degeneracy by using Hadamard transforms for rectangular weight matrices
MACHINE LEARNING
-
Training Degeneracy in Rectangular Weight Matrices Without Hadamard
By
–
This is the training degeneracy that @jiawzhao is talking about if you only do identity initialization and not Hadamard for rectangular weight matrices
-
AGI Parameter Count vs Brain Synapses: Current Models Scale
By
–
A common view is that human level AGI will require a parameter count in the order of magnitude of the brain’s 100 trillion synapses. The large language models and image generators are only about 1/1000 of that, but they already contain more information than a single human
-
Cool Applications Of Artificial Intelligence In Modern Technology
By
–
Cool Applications Of #ArtificialIntelligence
Via @ingliguori #BigData #Analytics #DataScience #AI #IoT #IIoT #PyTorch #Python #TensorFlow #Java #JavaScript #CloudComputing #DevCommunity #DataScientist #Programming #DigitalTransformation #Cloud #MachineLearning #100DaysofCode -
Detecting Major AI Breakthroughs Before They Happen
By
–
a thing about research i didn't get before openai: frequently before a big idea gets figured it out, multiple teams can sort of detect it on radar through the fog. you get an idea of where it's going to be and the rough shape far before anyone actually lays eyes on it.
-
Hadamard Transform Essential for Dimension Changes and Degeneracy
By
–
The dimension changes need Hadamard transform and without it you have bad degeneracy. We discuss this in detail
-
H2O World Dallas Conference November 17 Machine Learning Event
By
–
Join us in person or virtually next week on November 17 at H2O World Dallas! The makers behind http://
H2O.ai will share the latest technology advancements, use cases, and best practices in machine learning. Attend H2O World Dallas: https://
hopin.com/events/h2o-wor
ld-dallas-b3f1dc1d-e6dc-4955-a2f8-2d22e7aeb5c2/registration?utm_campaign=h2o-world-dallas-2022&utm_source=twitter
… -
Potential Use Cases of Artificial Intelligence in Healthcare
By
–
#Infographic: Potential use cases of #AI in #healthcare
via @ingliguori #HealthTech #ArtificialIntelligence #Robotics #MedTech #DigitalTransformation #Cloud #MachineLearning #BigData #DX #Analytics #IIoT #DataScience #IoT #IoTPL #DEVCommunity -
Deterministic Initialization for Any Network Architecture
By
–
Thank you for tweeting our paper. This is the actual TLDR: We design the first deterministic initialization that works with any network architecture. This includes identity initialization when weight matrix is square and Hadamard initialization when weight matrix is rectangular.
-
Computer Vision and AI Transform Manufacturing Sustainability Impact
By
–
Thank you Mike, always appreciate your feedback! Could not agree more re the game changing impact here & also the evolution of these tools and techniques for #Sustainability impact in #manufacturing too – excellent trajectory here! #ComputerVision #MachineVision #IoT #IIoT #AI