AI agents consume 136 times more energy than chatbots, KAIST research warns of infrastructure crisis

AI's energy tax was already concerning. Research says AI agents are over hundred times worse

AI agents could consume 136 times more energy than today's AI, study finds The AI industry's soaring electricity demand has already become a growing concern for governments, utilities, and technology companies. But a new study suggests the next generation of artificial intelligence could make that problem significantly worse. Researchers from the Korea Advanced Institute of Science and Technology (KAIST) have published what they describe as the first comprehensive analysis of the energy cost of AI agents - AI systems capable of reasoning, planning, and completing tasks autonomously. Their findings show that these systems can consume up to 136.5 times as much energy per query as conventional generative AI models, raising fresh questions about whether the infrastructure supporting tomorrow's AI is ready for what's coming. Smarter AI comes with a much steeper electricity bill Unlike traditional chatbots that generate a single response to a prompt, AI agents repeatedly call large language models (LLMs), browse the web, execute code, use calculators, and interact with external software while solving complex tasks. While these capabilities make them significantly more useful for research, programming, and workplace automation, they also require far more computing resources. Recommended Videos Led by Professor Minsoo Rhu from KAIST's School of Electrical Engineering, the research team treated AI agents as a new category of data center workload. It measured their computational requirements in real-world scenarios. The results were striking. The researchers found that AI agents can increase response latency by up to 153.7 times compared to conventional chain-of-thought reasoning. More surprisingly, the expensive GPUs powering these workloads remained idle for up to 54.5 percent of execution time while waiting for external tools to finish their tasks. In other words, the hardware continues consuming power even when it isn't actively performing AI computation. Energy usage scales just as dramatically. Running an AI agent powered by a 70-billion-parameter language model, similar in size to today's commercial AI systems, required an average of 348.41 watt-hours per query. That's roughly 136.5 times higher than a conventional chatbot answering a straightforward question. To understand the broader implications, the team modelled a future where AI agents handle 13.7 billion requests per day - roughly equivalent to Google's daily search traffic. Under that scenario, AI infrastructure would require approximately 198.9 gigawatts of electricity, nearly half of the average power consumed across the entire United States and far beyond the capacity of today's AI data centers. The hidden cost of intelligence The findings arrive as companies including OpenAI, Google, Microsoft, Anthropic, and others increasingly invest in agentic AI, positioning it as the next major leap beyond conversational chatbots. But the study argues that improving AI models alone is no longer enough. Future progress will depend equally on more efficient semiconductors, better GPU utilization, smarter data-center design, and expanded power infrastructure. Professor Rhu says the research demonstrates that AI competitiveness is shifting from building "smarter AI" to building more efficient AI. The team believes future AI development will require a co-design approach, optimizing models, AI chips, servers, and energy systems together to keep operating costs manageable and ensure AI remains sustainable at scale. The paper, titled "The Cost of Dynamic Reasoning: Demystifying AI Agents and Test-Time Scaling from an AI Infrastructure Perspective," was presented at the IEEE International Symposium on High-Performance Computer Architecture (HPCA) earlier this year. The researchers have also open-sourced their AI agent benchmarks, hoping to encourage further work on reducing one of AI's fastest-growing -- and often overlooked -- costs: electricity.

Advanced AI uses 136.5 times more electricity than standard chatbots, study warns - The Korea Times

As AI takes on more complex tasks, its hunger for electricity skyrockets, as visualized in this AI-generated image. Courtesy of KAIST The next generation of artificial intelligence could trigger a massive global energy crisis. A groundbreaking new study by the Korea Advanced Institute of Science and Technology (KAIST) has quantified the hidden electricity costs of advanced AI agents for the first time. The findings reveal that these autonomous systems consume up to 136.5 times more energy per query than the conventional generative AI tools we use today. While standard chatbots simply answer a question and stop, AI agents act like digital assistants. Given a goal like planning a vacation or managing a budget, they independently figure out how to do it. To finish the job, the agent will search the internet, make calculations and execute commands entirely on its own. However, this independence comes at a massive environmental cost. To complete a complex task, the agent has to talk to itself and rerun its core AI programming over and over again. This continuous looping means answers can take 153.7 times longer to generate. Even worse, expensive computer graphics chips sit completely idle more than half the time, burning electricity while simply waiting for external websites and apps to respond. The strain on global data centers is immense. The KAIST research team, led by Rhu Min-soo, found that a single complex request to an AI agent burns through an average of 348.41 watt-hours of electricity. If these agents become mainstream and handle an estimated 13.7 billion requests globally per day, the power grid will not be able to cope. Total data center electricity demand would skyrocket to roughly half of the average energy consumption of the entire United States. Rhu warned that tech companies cannot just focus on making software smarter if they want a sustainable future. Instead, the tech industry must completely redesign AI models, microchips, and data center power grids from the ground up to handle this massive new workload before the grid collapses. This article was published with the assistance of generative AI and edited by The Korea Times.