Brings back old days of ReLU, MELU, SELU, ELU, GELU, LeakyReLU, PELU, thousands more variations.
Nostalgia for Activation Function Variations in Neural Networks
By
–
By
–
Brings back old days of ReLU, MELU, SELU, ELU, GELU, LeakyReLU, PELU, thousands more variations.