Sure. See the "Water Stewardship" section (pages 42 to 49) of this year's Google Environmental Report: https://
gstatic.com/gumdrop/sustai
nability/google-2024-environmental-report.pdf
…
SUSTAINABILITY
-
Google Water Stewardship Environmental Report 2024
By
–
-
Gemma 2 Models: Pre-training Emissions and Open-Source Inference
By
–
Here's info on the estimated emissions for pre-training for the Gemma 2 family of models (from a paper published in July 2024). Those models are open-sourced, so should be easy for external parties to measure inference costs under various compute environments/settings (as
-
Gemma 2 Pre-training Emissions Analysis Released
By
–
Here's info on the pre-training emissions of the Gemma 2 series of models, from a paper we released a few months ago (end of July 2024):
-
Gemma 2 Model Series: Emissions Estimates for AI Training
By
–
In July 2024, we released emissions estimates for pre-training the Gemma 2 model series (2B, 9B, and 27B parameter models, so ~12X, ~43X, and ~128X larger than the 213M parameter models you were looking at, and respectively trained on 2T, 8T, and 13T tokens of data). We estimate
-
AI Enters the Critical Mineral Race
By
–
AI Enters the Critical Mineral Race
#AI #AIio #BigData #ML #NLU #Futureofwork @TunstallAsc @StrategyFintech @TamaraMcCleary @TerenceLeungSF @psb_dc @thomaspower @vinod1975 @ylecun -
EcoCAR EV Challenge Year 3 Students Celebrated at Appreciation Night
By
–
Thanks for the shoutout! We loved celebrating Year 3 EcoCAR EV Challenge students at Team Appreciation Night.
-
Google AI Model Training Power and Emissions Analysis Study
By
–
https://
arxiv.org/abs/2104.10350 that I helped co-author has quite a lot of details for models from Google and other models. It's actually quite a lot of work to do this. Table 4 in the paper has information about the training power, emissions, etc. for the Evolved Transformer NAS, as -
Training Language Models Emissions Costs Misunderstood
By
–
It gives people a very incorrect view of the actual emissions costs of training language models. So people think "If a tiny model generated that much emissions, larger models must be thousands of times more than this" when in actual fact, because of the errors, this isn't the
-
Paper’s CO2 emissions claim for small transformer model corrected
By
–
Not sure what the more recent and much larger Gemma-2 models (2B, 9B and 27B parameters) have to do with this. The main issue is that your paper claimed that training a small 213m parameter transformer model emitted 284t CO2e, when in fact the correct number is 0.087 t CO2e, or
-
Emissions assessment errors in Evolved Transformer NAS research
By
–
I'm just looking at the timeline: 2019 – honest mistakes in Strubell et al. paper (
https://
arxiv.org/abs/1906.02243) in assessing emissions cost of Evolved Transformer neutral architecture search (off by 88X: 19X from not understanding the search process done in the actual So et al.