My order of magnitude is $20M to train a good 30B model (50/50 between data infrastructure + GPUs)
Training 30B Model Costs $20M GPU Data Infrastructure
By
–
By
–
My order of magnitude is $20M to train a good 30B model (50/50 between data infrastructure + GPUs)