@jeffdean - AI Dynamics - Page 46 of 60

Language Model Training CO2 Emissions Vastly Overestimated Study

By

–

02 September 2023 5h31

If you actually measure the cost of training a language model of the scale examined by Strubell et al. in
an efficient Google data center, CO2e numbers are off by 100,000X (2.4 kg CO2e vs flawed estimate of 284,000 kg)

→ View original post on X — @jeffdean

2 September 2023

Research Details in Academic Paper References and Appendices

By

@jeffdean

–

02 September 2023 5h31

I have tried. For more details about how this happened, see Table 1 & Appendices C and D of https://
arxiv.org/abs/2104.10350.

→ View original post on X — @jeffdean

2 September 2023

Preventing CO2e Estimation Misinformation in AI Research

By

@jeffdean

–

02 September 2023 5h07

Agreed. As a minimal baseline, I would suggest "If you're trying to estimate CO2e emissions of a model, reach out to paper authors to say 'We've computed X: did that seem right?'". This would have prevented some significant misinformation in the field (data incorrect by >3000X!)

→ View original post on X — @jeffdean

2 September 2023

ML Environmental Impact: Prioritize Actual Data Over Misinformation

By

@jeffdean

–

02 September 2023 4h09

At the same time, the ML environmental impact community should use actual data whenever possible, and avoid wildly inaccurate estimates. There's a lot of misinformation and flawed data in the community that leads to wild headlines. Real data helps us focus on the right things!

→ View original post on X — @jeffdean

2 September 2023

ML Researchers Should Prioritize Energy Efficiency and Sustainability

By

@jeffdean

–

02 September 2023 4h03

I care about this topic as well. ML researchers should strive to use efficient algorithms and hardware, run computations in environmentally friendly data centers using locations with high CFE% energy, etc.
1/

→ View original post on X — @jeffdean

2 September 2023

Google AI Ghana Office Raises Awareness Among JFK Airport Staff

By

@jeffdean

–

02 September 2023 1h55

So, @GoogleAI office in Ghana has 67% awareness among @Delta baggage staff in JFK. We had a great chat about AI, computer science, their home countries (all from various Caribbean nations), & their side educational pursuits. At 4 AM, I was on my way w/my bag & a on my face.

→ View original post on X — @jeffdean

2 September 2023

Google AI Office Visit Cancelled: Traveler’s Accra Trip Scrapped

By

@jeffdean

–

02 September 2023 1h45

So, I spent 2 AM to 4 AM in @Delta baggage office at JFK to retrieve my bag so I could fly home on 6 AM flight instead. Friendly baggage office staff and I got to chatting, and I mentioned I my trip to visit the @GoogleAI office in Accra was scrapped and I was sad.
2/

→ View original post on X — @jeffdean

2 September 2023