Supermicro Unveils Comprehensive Liquid Cooling Solution for AI-Driven Data Centers

Supermicro's datacenter-scale liquid cooling solution sets the stage for Nvidia Blackwell

Supermicro's new liquid cooling solution enables up to 96 B200 GPUs per rack. As GPUs for AI and HPC applications get more power-hungry, they require better cooling. For example, a rack with 72 Nvidia B200 GPUs is projected to consume around 120 kW, which is 10 times higher than a typical rack power. As a result, Blackwell-based servers will mandate liquid cooling. On Monday, Supermicro introduced its datacenter-scale liquid cooling solution to prepare for these next-generation servers. Supermicro's new complete system includes advanced cooling components, software, and management tools to optimize performance and sustainability. In particular, the solution incorporates Coolant Distribution Units (CDUs), cold plates, Coolant Distribution Manifolds (CDMs), cooling towers, and SuperCloud Composer software for end-to-end management. This setup is intended to lower initial investment costs and the total cost of ownership (TCO) by making datacenters more energy-efficient. Supermicro's cooling technology is aimed at ultra-dense AI servers, each capable of housing dual top-tier CPUs and up to eight Nvidia HGX GPUs in a 4U configuration as well as up to 96 B200 GPUs per rack. This enables four times the computing density compared to traditional setups. One of the key benefits of Supermicro's liquid cooling solution is its rapid deployment capability. Supermicro's modular design reduces the time required to get datacenters up and running, cutting it down from months to weeks, which is crucial for companies looking to upgrade or build new facilities quickly. The solution's liquid cooling capabilities are engineered to handle extreme heat levels, efficiently cooling servers that demand up to 12kW of power and AI racks generating over 100kW of heat, exactly what Blackwell-based NVL72 servers need. Supermicro's technology also supports warm water cooling, reaching temperatures up to 113°F (45°C). This feature not only boosts cooling efficiency but also makes it possible to repurpose the heat for applications like district heating or greenhouse warming. The SuperCloud Composer software included in the package offers real-time monitoring and control over all components. It helps data center operators manage costs and maintain system reliability, ensuring that operations run smoothly and efficiently. Supermicro said that it had recently implemented over 100,000 GPUs using its liquid cooling solution (DLC) in some of the largest AI facilities ever built, along with other cloud service providers (CSPs). "Supermicro continues to innovate, delivering full datacenter plug-and-play rack scale liquid cooling solutions," said Charles Liang, CEO and president of Supermicro. "Our complete liquid cooling solutions, including SuperCloud Composer for the entire life-cycle management of all components, are now cooling massive, state-of-the-art AI factories, reducing costs and improving performance. The combination of Supermicro deployment experience and delivering innovative technology is resulting in data center operators coming to Supermicro to meet their technical and financial goals for both the construction of greenfield sites and the modernization of existing data centers. Since Supermicro supplies all the components, the time to deployment and online are measured in weeks, not months."

Supermicro, Inc. Announces Complete Liquid Cooling Solution

Supermicro, Inc. announced a complete liquid cooling solution that includes powerful Coolant Distribution Units (CDUs), cold plates, Coolant Distribution Manifolds (CDMs), cooling towers and end to end management software. This complete solution reduces ongoing power costs and Day 0 hardware acquisition and data center cooling infrastructure costs. The entire end-to-end data center scale liquid cooling solution is available directly from Supermicro. Many organizations require the highest-performing GPUs and CPUs to remain competitive and need these servers to run constantly. Supermicro's ultra-dense server with dual top-bin CPUs and 8 NVIDIA HGX GPUs in just 4U with liquid cooling is the ultimate AI server needed in AI factories. Datacenter-scale liquid cooling significantly reduces the power demand for a given cluster size. Up to 40% power reduction allows to deploy more AI servers in a fixed power envelope to increase computing power and decrease LLM time to train, which are critical for these large CSPs and AI factories. The entire liquid cooling solution directly from Supermicro includes: Optimally designed cold plates that allow liquid to flow through microchannels with a maximum surface area that dissipates up to 1600W for next-generation GPUs. Specifically designed CDM (horizontal and vertical) to enable the highest GPU per rack density with up to 96 NVIDIA B200 GPUs per rack. Rack-CDU solutions with increased cooling capacity of 250kW and hot swappable pumps and power supplies to avoid any downtime. Modular cooling towers tailored to cool DLC Racks with the latest energy efficient EC fan technology are ready to ship and deploy in days, enabling a faster Time-to-Online (TTO). SuperCloud Composer life cycle management software monitors the systems, SW, CDUs, racks, and cooling towers, optimizing the operational cost and managing the integrity of liquid-cooled data centers. Direct Liquid Cooling delivers several advantages over air cooling, including: Up to 40% energy savings for infrastructure and 80% space savings, eliminating the need for traditional CRAC/CRAH units. Support for warm water cooling up to 113degF (45degC) and allow for the reuse of heat generated by AI systems for applications such as district heating and greenhouses. Supermicro's leadership in Direct Liquid Cooling (DLC) technology is revolutionizing data center infrastructure towards Green Computing. From winning top industry awards to setting new efficiency benchmarks with a PUE of less than 1.1, Supermicro DLC solutions are leading in innovation and sustainability. By integrating DLC with modular cooling towers and SuperCloud Composer management software, Supermicro provides an end-to-end, complete data center scale total solution empowering CSPs and enterprise customers to achieve more with less while achieving higher operational efficiency, lower environmental impacts and much quicker TTO.

Supermicro introduces full-scale liquid cooling for data centers By Investing.com

SAN JOSE, Calif. - Supermicro, Inc. (NASDAQ: SMCI), recognized for IT solutions for cloud and AI, has announced the launch of a comprehensive liquid cooling solution designed to reduce total cost of ownership (TCO) and enhance performance for large AI clusters. This solution, aimed at addressing the high energy demands of the latest GPUs and CPUs, has been implemented in over 2,000 liquid-cooled racks since June 2024. The company's liquid cooling technology is engineered to handle servers that require intense power for artificial intelligence (AI) and high-performance computing (HPC) workloads. According to Supermicro, their ultra-dense servers equipped with dual CPUs and eight NVIDIA (NASDAQ:NVDA) HGX GPUs can quadruple computing density within a 4U space. This allows for larger AI models to be run with a smaller data center footprint. Supermicro's CEO, Charles Liang, stated that their liquid cooling solutions are now cooling massive AI factories. He highlighted the benefits of their technology in terms of cost reduction and performance improvement. Liang emphasized the speed of deployment as a key advantage, with projects typically going online within weeks. The liquid cooling package includes cold plates, Coolant Distribution Units (CDUs), Manifolds (CDMs), cooling towers, and management software. By leveraging direct liquid cooling (DLC), Supermicro claims up to 40% energy savings for infrastructure and 80% space savings compared to traditional cooling methods. Their solutions also support warm water cooling, which can repurpose the heat generated by AI systems for other applications. Supermicro's recent deployments include over 100,000 GPUs with liquid cooling for some of the largest AI factories, addressing the challenge of efficiently removing heat generated by AI racks that exceed 100kW. The company asserts that their technology is revolutionizing data center infrastructure towards more sustainable practices, with a power usage effectiveness (PUE) of less than 1.1. The press release statement from Supermicro underscores their commitment to innovation and sustainability in data center cooling solutions, positioning them as a leader in the field of green computing. In other recent news, Super Micro Computer (NASDAQ:SMCI) announced significant financial developments, including a ten-for-one forward stock split and amendments to its financial agreements. The company also reported record annual revenues of $14.94 billion and fourth-quarter revenues of $5.31 billion. However, the company is under investigation by the U.S. Department of Justice for alleged accounting manipulation. In terms of product offerings, Super Micro expanded its X14 server portfolio with the integration of new Intel (NASDAQ:INTC) Xeon 6900 Series Processors, optimized for high-performance computing, artificial intelligence, and cloud services. The company also unveiled its high-density FlexTwin family of systems, designed to meet the demands of complex computing environments. In the realm of analyst notes, Loop Capital maintained its buy rating on Super Micro Computer shares, albeit with a reduced price target. Meanwhile, Needham initiated coverage on Super Micro with a buy rating, citing the company's potential for growth in AI infrastructure. These are the latest developments in the company's ongoing activities. Supermicro's recent announcement of its comprehensive liquid cooling solution aligns well with the company's strong financial performance and market position. According to InvestingPro data, Supermicro (NASDAQ: SMCI) has shown impressive revenue growth, with a 109.77% increase in the last twelve months as of Q4 2024. This growth is particularly noteworthy in the context of the company's innovative cooling solutions for AI and HPC workloads. An InvestingPro Tip highlights that analysts anticipate sales growth in the current year, which is consistent with the company's expanding presence in the liquid cooling market for AI clusters. The implementation of over 2,000 liquid-cooled racks since June 2024 suggests that Supermicro is capitalizing on the growing demand for energy-efficient data center solutions. Another relevant InvestingPro Tip indicates that Supermicro is trading at a low P/E ratio relative to near-term earnings growth. With a P/E ratio of 20.52 and a PEG ratio of 0.26, the company's stock may be attractively valued considering its growth prospects in the AI and HPC markets. It's worth noting that Supermicro's gross profit margin stands at 14.13%, which may reflect the competitive nature of the hardware industry. However, the company's focus on high-value, energy-efficient solutions like liquid cooling could potentially improve margins in the future. For investors interested in a deeper analysis, InvestingPro offers 13 additional tips for Supermicro, providing a more comprehensive view of the company's financial health and market position.