3/The reason these are all so close together timing-wise is that every lab got their H100s at roughly the same time. They each struggled with early issues with the H100s last fall, and the big H100 clusters all started training this spring. Voila, 5-6 months later, big models!

→ View original post on X — @alexandr_wang,