L1 penalty doesn’t actually make truly sparse features with standard optimizers either — it overshoots zero back and forth.
L1 Penalty Limitations: Overshooting Zero with Standard Optimizers
By
–
By
–
L1 penalty doesn’t actually make truly sparse features with standard optimizers either — it overshoots zero back and forth.