AI Dynamics

Global AI News Aggregator

About

Nostalgia for Activation Function Variations in Neural Networks

Brings back old days of ReLU, MELU, SELU, ELU, GELU, LeakyReLU, PELU, thousands more variations.

→ View original post on X — @jeande_d