NVIDIA's GB300 'Blackwell Ultra' AI Servers: A Leap Towards Fully Liquid-Cooled AI Clusters

NVIDIA's GB300 'Blackwell Ultra': A New Era in AI Computing

NVIDIA is poised to unveil its next-generation AI GPU, the GB300 'Blackwell Ultra', at the upcoming GPU Technology Conference (GTC) 2025. This new hardware represents a significant leap in AI computing capabilities and marks a transition towards fully liquid-cooled AI clusters 1

1

2

Performance and Specifications

The GB300 is expected to offer substantial improvements over its predecessor:

• Up to 50% faster FP4 computing performance compared to GB200 2

  2

• Increased HBM3E memory capacity of 288GB, up from 192GB 2

  2

  3

  3

• Thermal Design Power (TDP) of up to 1.4kW, indicating a significant increase in power consumption 2

  2

These enhancements suggest that NVIDIA is pushing the boundaries of AI computing power, catering to the growing demands of complex AI workloads.

The "Second Cooling Revolution"

The increased power and heat dissipation of the GB300 have necessitated a shift in cooling technology:

• Transition from air cooling to fully liquid-cooled systems 1

  1

  3

  3

• 4x increase in the use of water-cooling quick connectors compared to GB200 1

  1

• Complex power management design to handle increased energy consumption 1

  1

This move towards liquid cooling is being referred to as the "second cooling revolution" in the industry 1

1

Impact on the Supply Chain

The shift to liquid cooling is expected to have significant implications for the hardware supply chain:

• Taiwanese cooling companies like Shuanghong and Qihong are anticipated to see "huge profits" 1

  1

• Water-cooling quick connector suppliers such as Fushida and Shishuo will play a crucial role 1

  1

• AI server power supplies are expected to increase from 3kW to as high as 10kW later this year 1

  1

Related Stories

Nvidia Unveils Blackwell Ultra B300: A Leap Forward in AI Computing

NVIDIA's AI AI server evolution: GB300 production ramps up as Vera Rubin looms on the horizon

NVIDIA Unveils Blackwell Ultra GB300: A Leap Forward in AI Accelerator Technology

NVIDIA Unveils Roadmap for Next-Gen AI GPUs: Blackwell Ultra and Vera Rubin

Future Developments: Rubin AI Architecture

While the GB300 is the immediate focus, NVIDIA is also preparing for the future with its next-generation Rubin AI architecture:

• Dual logic chip structure fabricated on TSMC's N3 process node 2

  2

• Up to 384GB of next-gen HBM4 memory 2

  2

• Increased TDP of up to 1.8kW 2

  2

• Expected to start production in late 2025 2

  2

Market Implications

The introduction of the GB300 and the shift to liquid cooling are expected to have significant market impacts:

• Potential increase in server prices due to advanced cooling technology 3

  3

• Current GB200 NVL72 servers cost around $3 million, suggesting higher prices for GB300 3

  3

• NVIDIA's dominant market position may drive adoption despite potential yield rate issues 3

  3

As the AI industry continues to evolve rapidly, NVIDIA's GB300 'Blackwell Ultra' represents a significant step forward in computing power and efficiency. The move towards fully liquid-cooled AI clusters signals a new era in AI infrastructure, with far-reaching implications for the technology sector and its supply chain.