Memorization Capacity of Deep Neural Networks under Parameter Quantization in 2019 these folks measured the capacity of RNNs/CNNs/MLPs, also using this class-based entropy idea they quantized the networks to half-precision and saw a capacity drop (but not nearly by half)

→ View original post on X — @jxmnop