We supported shared weights from very early in DistBelief development, and we started adding support for various kinds of convolutions in March of 2012 (because convolutions are a very sensible idea for some things!), and you visited in July, I believe.
MACHINE LEARNING
-
matRBM: Early Open Source Project for Restricted Boltzmann Machines
By
–
It was the worst. But it did have a few really awesome UI features, a built-in debugger, persistent memory, etc. This is one of my first open source projects ever: https://
code.google.com/archive/p/matr
bm/
…
matRBM, a library to train Restricted Boltzmann Machines in Matlab 🙂 Main training loop: -
DistBelief Convolutions Backpropagation Training Before ICML 2012
By
–
DistBelief supported convolutions and end-to-end training with convolutions via backprop before the ICML 2012 paper appeared (even though that particular paper didn't use convolutions).
-
Mapping the Mind: Speech Production Understanding Advances
By
–
Mapping The Mind: Advances In Understanding Speech Production https://
forbes.com/sites/williamh
aseltine/2024/04/08/mapping-the-mind-advances-in-understanding-speech-production/?utm_source=dlvr.it&utm_medium=twitter
… #Innovation #ArtificialIntelligence #MachineLearning -
Matrix Classes and Neural Networks: From BPTT to Modern Frameworks
By
–
In the 90s I had to first implement matrix classes before I could even start coding neural nets – it was awful! I suffered so much with BPTT! Matlab did make things more efficient and was great until Python arrived. Leon Bottou and Yann Lecun pioneered SGD and torch style
-
Automatic Differentiation Frameworks Revolutionized Machine Learning Development
By
–
To be honest, Geoff still uses Matlab and that is how we got dropout and distillation. I think software frameworks based on automatic differentiation (eg torch) changed the game, but whether it was lua, matlab or python seemed to matter less. Granted I prefer python and indeed my
-
18 Essential Data Science Tools for Analytics Professionals
By
–
18 data science tools to consider using in 2024. https://
techtarget.com/searchbusiness
analytics/feature/15-data-science-tools-to-consider-using
… via @techtargetnews #DataScience #analytics #datasets #code #Javascript #Data #DataScientists #SQL #BigData #Python #Tech #IoT #ML #NLP #TensorFlow #Coding #codenewbies #100DaysOfCode -
Cool Lion AI Supports Farmers in Côte d’Ivoire Innovation
By
–
How Does A ‘Cool Lion’ Help Farmers In Cote D’Ivoire? https://
forbes.com/sites/andrewwi
ght/2024/04/08/how-does-a-cool-lion-help-farmers-in-cote-divoire/?utm_source=dlvr.it&utm_medium=twitter
… #Innovation #ArtificialIntelligence #MachineLearning -
Scaling Deep Learning: The Controversial Path to AI Performance
By
–
Back then, the idea that scaling deep learning would lead to significant performance gains was controversial. Several senior academic colleagues were advising me not to waste time trying to scale deep learning, but to just focus on inventing new algorithms, which was where they
-
Google Brain’s Iconic Cat Image: A Defining Moment
By
–
Yup. By the way @quocleix
, I still remember the time we were both in the office, and you waved at me to come over to your desk to look at your new result. And right there on your monitor was the now-famous Google Cat image. That was a defining moment for Google Brain!