CODE

Training Degeneracy in Rectangular Weight Matrices Without Hadamard

By

–

11 November 2022 8h05

This is the training degeneracy that @jiawzhao is talking about if you only do identity initialization and not Hadamard for rectangular weight matrices

ZerO Initialization and Hadamard Transforms for Rectangular Matrices

By

–

11 November 2022 8h04

And an overview of how ZerO initialization can overcome degeneracy by using Hadamard transforms for rectangular weight matrices

→ View original post on X — @haroldsinnott

Best SQL Cheat Sheet for Data Science and Machine Learning

By

@haroldsinnott

–

11 November 2022 8h00

Best of #SQL Cheat Sheet #MachineLearning #DataScience #Cybersecurity #BigData #Analytics #AI #IIoT #IoT #5G #Python #RStats #TensorFlow #JavaScript #ReactJS #FutureOfWork #DataScientist #Linux #Programming #100DaysofCode #NodeJS #golang #NLP #GitHub #CES2023 #SDGs #MLOps

→ View original post on X — @haroldsinnott

Python Cheat Sheet Keywords Guide

By

@haroldsinnott

–

11 November 2022 6h20

#Python Cheat Sheet: Keywords #MachineLearning #IoT #100DaysOfCode #programming #CodeNewbie #reactjs #bugbounty #DataScience #gamedev #BigData #Analytics #NeuralNetworks #IR4 #OpenSource #AI #5G #DEVCommunity #CES2023 #codinglife #Automation #FutureOfWork #SDGs #RPA via #Finxter

→ View original post on X — @learnopencv

Free OpenCV Crash Course for National Education Day

By

@learnopencv

–

11 November 2022 4h02

Celebrate National Education Day with our FREE OpenCV Crash Course https://
opencv.org/opencv-free-co
urse/
… #learnopencv #opencv #artificialintelligence #deeplearning #machinelearning #education #educationday #nationaleducationday #ai

→ View original post on X — @nvidiaai

Build Train Evaluate GPT Models NVIDIA NeMo Megatron

By

@nvidiaai

–

11 November 2022 1h00

Learn how to construct, train, and evaluate a GPT model using NVIDIA NeMo with Megatron on Jupyter Notebooks in a new free, hands-on lab from NVIDIA LaunchPad. Get started: https://
nvda.ws/3tm9ABs

→ View original post on X — @datachaz

GitHub’s new file browser revolutionizes repository navigation experience

By

@datachaz

–

10 November 2022 23h14

The new default file browser on @GitHub is A game changer in browsing out repositories!

10 November 2022

ZerO Initialization with Hadamard Transforms for Rectangular Matrices

By

–

10 November 2022 22h44

And an overview of how ZerO initialization can overcome degeneracy by using Hadamard transforms for rectangular weight matrices

10 November 2022

Training Degeneracy in Rectangular Weight Matrices Without Hadamard

By

–

10 November 2022 22h43

This is the training degeneracy that @jiawzhao is talking about if you only do identity initialization and not Hadamard for rectangular weight matrices