I started out with an instinctive dislike of max-pooling in ML networks, favoring avg-pooling based on image filtering concepts. I only later realized that it isn’t really doing image processing, but rather acting as a “spatial ReLU”.

→ View original post on X — @id_aa_carmack,