the models are homogeneous, the hardware SKUs are homogeneous, so the overall perf tuning/search space is relatively small. So, the bounded search makes it less moaty — competitors are also searching within the same bounded space.
I cover more on this in my upcoming Latent Space

→ View original post on X — @soumithchintala