CoreWeave Deploys First Nvidia Blackwell Ultra AI Supercomputers, Marking a Milestone in AI Infrastructure

CoreWeave Leads the Pack with Nvidia's Latest AI Supercomputers

In a significant development for the AI industry, CoreWeave, a prominent AI cloud service provider, has become the first to deploy Dell-built systems featuring Nvidia's cutting-edge GB300 NVL72 Blackwell Ultra AI supercomputers 1

1

. This deployment marks a major milestone in AI computing capabilities and underscores CoreWeave's growing influence in the competitive AI cloud-computing space.

Technical Specifications and Performance Boost

The initial rollout involves Dell Integrated Racks equipped with impressive specifications:

• 72 Nvidia Blackwell Ultra GPUs
• 36 Arm-based 72-core Grace CPUs
• 36 BlueField DPUs per rack

Each GB300 NVL72 rack delivers:

• 1.1 ExaFLOPS of dense FP4 inference
• 0.36 ExaFLOPS of FP8 training performance

This represents a 50% performance increase compared to the previous GB200 NVL model 1

1

. Additionally, each rack boasts 20 TB of HBM3E and 40 TB of total RAM, utilizing Nvidia's Quantum-X800 InfiniBand switches and ConnectX-8 SuperNICs for scale-out connections at up to 14.4 GB/s, twice as fast as previous iterations.

Advanced Cooling and Power Management

These densely configured systems are designed for maximized training and inference performance, necessitating liquid cooling due to their extreme power consumption of up to 1,400W per GPU 4

4

. This advanced cooling solution ensures optimal performance while managing the substantial heat generated by these powerful components.

Industry Impact and Future Prospects

CoreWeave's deployment of these state-of-the-art systems is expected to significantly enhance its cloud platform capabilities. The company aims to handle more advanced large language model training, reasoning processes, and inferencing 2

2

. CoreWeave's CEO stated that the new system will enable their clients to "develop and deploy larger, more complex AI models that are exponentially faster than ever before."

The market has responded positively to this news, with CoreWeave's shares rising 6% during trading following the announcement. Dell and Nvidia also saw modest gains in their stock prices 3

3

.

Rapid Technological Advancement

It's worth noting that this deployment comes just seven months after CoreWeave and Dell deployed the first GB200 NVL72 machines. This rapid succession of upgrades raises questions about the longevity of AI hardware platforms and suggests a significant demand for Nvidia's latest Blackwell Ultra technology 1

1

.

As CoreWeave continues to deploy more GB300 NVL72-based racks, the total performance available to its customers, including high-profile clients like OpenAI, is expected to increase substantially. This development not only showcases CoreWeave's commitment to staying at the forefront of AI technology but also highlights the rapid pace of advancement in the AI hardware sector.