Sustainable

This research investigates methods for developing environmentally sustainable natural language processing systems, focusing on reducing computational costs and energy consumption. The study analyzes various efficiency techniques specific to NLP tasks, including model compression, efficient attention mechanisms, and task-specific optimizations. The authors provide empirical evidence of energy savings and performance trade-offs across different NLP tasks and model architectures.

As Generative AI becomes increasingly integrated into real-world services, energy consumption has become a significant bottleneck—yet it remains under-measured and under-optimized in machine learning (ML) systems. This paper introduces the ML.ENERGY Benchmark and Leaderboard, an open-source suite and evaluation platform designed to measure and compare the inference energy use of AI models in realistic service environments. The authors present four core principles for effective energy benchmarking and illustrate their application within the tool. Results from the benchmark detail energy metrics for 40 popular model architectures across 6 tasks, showcase case studies on design decisions affecting energy use, and demonstrate that automatic optimizations can cut energy consumption by over 40% without sacrificing output quality. The ML.ENERGY Benchmark is extensible, making it a practical resource for both researchers and practitioners seeking to evaluate and minimize the energy footprint of their AI applications.