New Software Tool Reduces AI Training Energy Waste by Up to 30%

Curated by THEOUTPOST

On Fri, 8 Nov, 8:03 AM UTC

3 Sources

Share

Researchers at the University of Michigan have developed Perseus, a software tool that can reduce energy consumption in AI training by up to 30% without compromising speed or performance, potentially saving enough energy to power 1.1 million U.S. homes by 2026.

Energy Waste in AI Training

A new study from the University of Michigan has revealed that up to 30% of the power used to train large AI models, such as GPT-3, is wasted. This inefficiency stems from the unequal distribution of workload across multiple GPUs (Graphics Processing Units) during the training process 1.

The Perseus Solution

To address this issue, researchers have developed a software tool called Perseus. This innovative solution identifies the critical path in AI training tasks and adjusts processor speeds accordingly, ensuring all processors finish their jobs simultaneously. By doing so, Perseus can reduce energy consumption by up to 30% without compromising training speed or model accuracy 2.

Potential Impact

The energy savings achieved by Perseus could be substantial. Based on Wells Fargo's projections of AI power demand, the approach could save enough energy to power 1.1 million U.S. homes in 2026. This reduction in energy consumption could also help mitigate the environmental impact of data centers, which the International Monetary Fund predicts could account for 1.2% of global carbon emissions by 2027 3.

The Need for Efficiency

Mosharaf Chowdhury, associate professor of computer science and engineering at the University of Michigan, emphasizes the importance of this development: "We can't keep building bigger and bigger data centers because we won't have the power to run them. If we can reduce the energy consumed by AI, we can reduce AI's carbon footprint and cooling requirements and allow for more computation to fit within our current energy constraints" 1.

How Perseus Works

Perseus tackles the inefficiency created when AI training tasks are unevenly distributed across multiple processors. Current methods run all processors at top speed, resulting in some finishing their calculations before others. Perseus identifies the longest series of subtasks (the critical path) and slows down processors not on this path, ensuring all processors complete their work simultaneously and eliminating unnecessary power use 2.

Implications for AI Accessibility

The researchers argue that reducing AI power costs could have significant implications for equitable AI access. Chowdhury notes, "If a country doesn't have enough power to run a big model, they might need to use services from far away, or be stuck running smaller, less accurate models. This gap could further perpetuate disparity between different communities" 3.

Testing and Availability

The team has tested Perseus by training GPT-3, three other large language models, and one computer vision model. Perseus is now available as an open-source tool, part of Zeus, which measures and optimizes AI energy consumption 1.

Continue Reading
DeepSeek's AI Efficiency: A Double-Edged Sword for Energy

DeepSeek's AI Efficiency: A Double-Edged Sword for Energy Consumption

Chinese startup DeepSeek claims to have created an AI model that matches the performance of established rivals at a fraction of the cost and carbon footprint. However, experts warn that increased efficiency might lead to higher overall energy consumption due to the Jevons paradox.

Washington Post logoThe Conversation logoThe Verge logoTechRadar logo

5 Sources

Washington Post logoThe Conversation logoThe Verge logoTechRadar logo

5 Sources

Breakthrough in AI Energy Efficiency: New Systems Promise

Breakthrough in AI Energy Efficiency: New Systems Promise Drastic Reduction in Power Consumption

Researchers develop innovative methods to significantly reduce AI's energy consumption, potentially revolutionizing the industry's environmental impact and operational costs.

Softonic logoWorld Economic Forum logo

2 Sources

Softonic logoWorld Economic Forum logo

2 Sources

The Hidden Environmental Cost of AI: ChatGPT's Massive

The Hidden Environmental Cost of AI: ChatGPT's Massive Energy Consumption

As AI technology advances, concerns grow over its environmental impact. ChatGPT and other AI models are consuming enormous amounts of energy and water, raising questions about sustainability and resource management in the tech industry.

Tom's Guide logoDigital Trends logoTom's Hardware logo

3 Sources

Tom's Guide logoDigital Trends logoTom's Hardware logo

3 Sources

The Environmental Impact of AI: Balancing Innovation and

The Environmental Impact of AI: Balancing Innovation and Energy Consumption

As artificial intelligence continues to advance, concerns grow about its energy consumption and environmental impact. This story explores the challenges and potential solutions in managing AI's carbon footprint.

The Hill logoObserver logoThe Financial Express logoForbes logo

5 Sources

The Hill logoObserver logoThe Financial Express logoForbes logo

5 Sources

The Environmental Impact of AI: Challenges and Solutions

The Environmental Impact of AI: Challenges and Solutions for a Sustainable Future

The rapid growth of AI technology has raised concerns about its environmental sustainability. This story explores the energy consumption of AI models, their carbon footprint, and potential solutions for a greener AI industry.

TechRadar logoNature logo

2 Sources

TechRadar logoNature logo

2 Sources

TheOutpost.ai

Your one-stop AI hub

The Outpost is a comprehensive collection of curated artificial intelligence software tools that cater to the needs of small business owners, bloggers, artists, musicians, entrepreneurs, marketers, writers, and researchers.

© 2025 TheOutpost.AI All rights reserved