Nvidia Claims 45°C Liquid Cooling Solves AI's Water Challenge for Data Centers

Hotter Than a Hot Tub: The 45°C Breakthrough to Cool AI's Biggest Machines

Your browser doesn't support HTML5 video. Here is a link to the video instead. Hot tubs sit at about 38 to 40 degrees Celsius, warm enough that most people can only soak for about 15 minutes. NVIDIA's newest AI servers can run their cooling liquid even hotter -- up to 45 degrees Celsius, or 113 degrees Fahrenheit. That higher temperature limit is precisely what makes them more energy efficient. The Rubin generation of NVIDIA AI infrastructure is the world's first to achieve 100% liquid cooling -- every chip, every networking component, cooled entirely by liquid in a closed loop with no fans anywhere in the system. This liquid cooling methodology is outlined in the NVIDIA DSX AI factory reference design, a guide that outlines best practices to design, build and operate the entire AI factory infrastructure stack. Although each generation offers significantly more computing power for each watt, full liquid-cooled AI compute infrastructure enables data centers to dramatically reduce cooling energy consumption -- making a meaningful difference to overall data center energy use at hyperscale. "The NVIDIA DSX reference design for AI factories has zero water consumption -- we have eliminated massive amounts of power usage and pretty much all water usage," said Ali Heydari, director of data center cooling and infrastructure at NVIDIA. "With dry-cooler-based designs, it's a closed-loop system with no evaporative water cooling -- outside of maybe 1% of the year when we might need chillers in some climates." Historically, cooling alone has accounted for up to 40% of a data center's electricity consumption, making it one of the most significant areas where efficiency improvements can drive down both operational expenses and energy demands. Industry estimates suggest that raising chiller plant temperatures by just one degree can cut cooling energy costs by about 4%. At scale, those savings add up quickly. A 50-megawatt hyperscale facility can save over $4 million annually in cooling-related energy and water costs by moving to liquid-cooled infrastructure. In favorable climates, NVIDIA's 45-degree liquid-cooling architecture can enable chiller-less operation with dry coolers, reducing facility cooling water consumption from roughly 2.6 million gallons per megawatt per year for conventional cooling-tower-based systems to near zero -- up to a 100% reduction in water use. The reason: traditional air-cooled data centers depend on large volumes of cooled air to remove heat from IT equipment, often requiring energy-intensive cooling infrastructure during hot weather. With NVIDIA's 45-degree liquid cooling, heat is captured directly at the chip and transported through liquid loops operating at much higher temperatures, allowing outdoor dry coolers to reject heat efficiently for much of the year while significantly reducing mechanical cooling requirements and facility water consumption. The data center ambient temperature is flexible -- warm summer air is fine -- because nothing in the server depends on cool air. The liquid does all the work -- and the same liquid can be recirculated in a closed loop so no new water is consumed to cool the chips. A New Standard for the Industry Because the NVIDIA Rubin platform integrates 100% liquid-cooled infrastructure, every cloud provider and data center operator building for it is making the transition. The ecosystem is keeping pace. Motivair, the advanced cooling division of Schneider Electric, has worked alongside NVIDIA's product roadmap for nearly a decade -- and Richard Whitmore, its president and CEO, says the relationship only intensified as power densities crossed the threshold where air cooling was no longer a viable option. "Once the watts per chip crossed a certain level, liquid cooling became mandatory," said Whitmore. Too Hot to Cool AI Infrastructure Is Hotter Than You'd Think There's a long-standing misconception in the industry that a cold data center is an efficient one. Decades ago, if a data center didn't feel like a walk-in freezer, people would assume something was wrong. In reality, chips can sustain far warmer environments than that instinct suggests. Silicon processors generate enormous internal heat -- the coolant entering a fully liquid-cooled chip at 45 degrees Celsius exits at roughly 55 degrees, having absorbed that heat load across the chip surface. Yet performance doesn't degrade. The processors continue to operate at full performance because liquid-cooled cold plates keep device temperatures within validated operating limits, even with coolant entering the rack at 45 degrees Celsius. No Fans, No Cold Aisles -- A Fundamentally Different Machine Walk into a traditional data center and notice two things: the noise -- cooling fans contribute to total noise levels at or above 85 decibels, loud enough to require ear protection -- and the physical choreography of hot aisles and cold aisles, carefully managed to push cooled air across components. The Rubin architecture changes the picture. Coolant -- 75% water and 25% propylene glycol -- flows through cold plates that sit directly on processors, pulling heat out at the source. Running that coolant at up to 45 degrees Celsius means that in many climates, the facility loop can reject heat without turning on mechanical chillers and noisy fans. That unlocks something beyond energy savings: the possibility of eliminating water consumption entirely. In the right geography -- somewhere with reliably cool outdoor air -- a liquid-cooled data center can reject its heat through coolant distribution units that capture heat directly at the source and transport it to outdoor dry coolers, essentially large radiator coils positioned outside the building. The loop is filled once and runs closed for the life of the facility. And it takes dramatically less space in the AI factory compared to traditional air-cooling infrastructure. "In the right geographic location, with the right system design, you don't need any refrigeration equipment," Whitmore said. "You can just put big radiator coils outside and use the air temperature for all your cooling. It's incredibly efficient." The geography caveat matters. A data center in the Scottish Highlands and one in Phoenix, Arizona, face very different realities. But even in warmer climates, the shift toward 45-degrees-Celsius coolant moves operators significantly closer to that chiller-less ideal -- where chillers may turn on just a few days a year when the outside air temperature demands it. Another key benefit of this new model for AI factories is the potential for waste heat recovery, where residual heat from AI factory operations can be repurposed to heat commercial or residential buildings nearby. The Engineering Problem Nobody Had Solved Previous liquid-cooled servers were hybrid: GPUs and CPUs got cold plates, but the rest of the system stayed air-cooled, with finned heat sinks designed to shed heat into moving air. In a fully liquid-cooled server, the cooling for these components needed to be completely redesigned to use liquid. NVIDIA's thermal engineering team reworked how those components handle heat, designing cooling loops that simplify how liquid is routed to multiple high-power chips on the board using a single inlet and outlet, resulting in a cleaner tray-level cooling architecture. One visible outcome: Rubin servers have clean, sealed front panels where air-cooled servers have perforated bezels. Another: fully liquid cooled servers enable higher rack density than air-cooled servers, so a system that previously occupied six rack units now fits in two -- more compute, less space, less noise. AI workloads are not getting lighter. The compute demand driving data center construction is growing faster than almost any other category of infrastructure investment. Without efficiency improvements in how that compute is cooled, the energy cost of running AI at scale would grow in lockstep with the hardware. Liquid cooling at up to 45 degrees Celsius -- hotter than a hot tub, cooler for the planet -- is one of the most important tools the industry has to close that gap. Learn more about liquid cooling, the NVIDIA DSX platform for AI factories and NVIDIA's approach to energy-efficient AI infrastructure.

Nvidia says AI's water challenge is largely solved

Why it matters: It's a bold claim with high stakes by the world's dominant chip maker. Data centers are facing growing scrutiny for their use of energy and water, and Nvidia's chips are helping drive the AI boom behind much of that demand. Driving the news: Nvidia announced Monday at London Climate Week that its latest AI system can be fully cooled with liquid warm enough to reduce the need for additional chilling equipment. * "The water consumption challenge for data centers is largely solved," said Josh Parker, Nvidia's chief sustainability officer, in an interview last week ahead of his trip to London. The big picture: Nvidia's announcement comes on the heels of Google and Amazon defending their data center water practices amid growing local opposition to AI infrastructure. * Tech companies are increasingly arguing that efficiency gains will blunt the environmental impacts of the AI buildout. Between the lines: Nvidia's latest claim goes further, suggesting that next-generation AI systems could change the underlying cooling equation altogether. How it works: Nvidia's coolant -- a recirculated liquid mixture that includes water and propylene glycol, similar to automotive antifreeze -- can run at 113 degrees Fahrenheit. * Because the liquid can operate at higher temperatures than previous systems, data centers may be able to rely less on chilling equipment that uses large amounts of energy or water -- or even eliminate it altogether. What they're saying: "It would be a big deal for everybody if we got all of the chips to do that," said Steve Solomon, Microsoft's vice president of data center engineering, who was asked about the potential before learning of Nvidia's announcement. * Solomon said it could eliminate the need for any type of mechanical chiller in most climates most of the time -- even in hot places such as Arizona. Reality check: Even if Nvidia's technology dramatically reduces cooling-related water use, that doesn't mean water concerns disappear entirely. * The new systems would take years to spread across the industry, and many existing data centers will continue operating older cooling technologies. * Nvidia declined to discuss the costs of its systems, and the pace of adoption may also depend on the economics of facilities designed for fully liquid-cooled AI infrastructure (though Nvidia says it'll save data center operators money on cooling costs). Zoom out: Water use inside a data center is only one piece of a broader debate. Producing the electricity needed to run AI infrastructure can also require significant amounts of water, depending on the power source. What's next: Nvidia's technology could make each unit of AI computing far more efficient, but the company is also explicit that those gains are meant to support more growth. * "AI workloads are not getting lighter," Parker wrote in a blog post. Without efficiency improvements, he argues, the energy needed to run AI would continue rising alongside demand. What we're watching: Efficiency gains may reduce the water and energy needed for each AI system. Those same gains could also accelerate the buildout of AI infrastructure and increase the industry's overall footprint.