No good reason, other than the fact that softmax puts a big weight on nearby contrastive samples.
MSE works just fine. But the contrastive should not be the one you write.
First, it should be lower bounded, something like Relu(m-dist(xi,xi')), which pushes samples away by at

→ View original post on X — @ylecun