Combined, training these lightweight Llama models required 916K GPU hours on NVIDIA H100-80GB. As part of Meta’s commitment starting in 2020, we’ve maintained net zero greenhouse gas emissions in our global operations and matched 100% of the electricity use from the training
Meta trains lightweight Llama models with net zero emissions
By
–
Leave a Reply