Carbon Emissions and Large Neural Network Training

This comprehensive study analyzes the real carbon footprint of training large neural network models, taking into account multiple often-overlooked factors.

The research provides a detailed methodology for calculating CO2 emissions and demonstrates how the choice of data center location and timing can significantly impact the environmental cost of AI training.

The authors show that thoughtful choices about where and when to train models can reduce CO2 emissions by up to 100x compared to random choices.