6/ so we won't see what would happen if you spent $100B of GPUs on a model for a while because of how spread out the GPU distributions are. we'd likely need to see $500B of aggregate GPU spend to have an individual model trained on $100B of GPUs (wow!)
GPU spending scale needed for hundred billion dollar model training
By
–