If you actually measure the cost of training a language model of the scale examined by Strubell et al. in
an efficient Google data center, CO2e numbers are off by 100,000X (2.4 kg CO2e vs flawed estimate of 284,000 kg)
Language Model Training CO2 Emissions Vastly Overestimated Study
By
–