5/ Going fwd, Google's TPU advantage will be very important. Every lab is reliant on their NVIDIA GPU allocations for progress, except for Google, who can successfully train on TPU clusters. This could mean that Google will have more compute than the other labs in perpetuity.

→ View original post on X — @alexandr_wang,