3. Softmax is an activation function that always returns the input value if positive and zeroes otherwise. 4. In neural networks, an activation function's most essential role is to decide whether a unit (or neuron) should fire.

→ View original post on X — @abacusai