the use of zero convolutions while training results in a funny behavior that the authors name “sudden convergence phenomenon”, where the model is suddenly able to follow the input conditions, as depicted in the following image:

→ View original post on X — @krea_ai