ZerO Initialization: Initializing Neural Networks with only Zeros and Ones A fully deterministic initialization scheme which sets the weights to only 0s and 1s can achieve SOTA on various datasets including ImageNet. Maybe random weights are unnecessary. https://
openreview.net/forum?id=1AxQp
KmiTc
…

→ View original post on X — @hardmaru