CoreWeave Deploys First Nvidia Blackwell Ultra AI Supercomputers, Marking a Milestone in AI Infrastructure

Nvidia's newest top-tier AI supercomputers deployed for the first time -- Grace Blackwell Ultra Superchip systems deployed at CoreWeave

Dell on Thursday said that it had delivered industry's first systems built on Nvidia's GB300 NVL72 platform to CoreWeave, a leading AI cloud service provider (CSP). CoreWeave said that it had deployed the Blackwell Ultra-based cluster with its data center hosting provider Switch. Dell's and CoreWeave's initial rollout involves Dell Integrated Racks equipped with 72 Nvidia Blackwell Ultra GPUs, 36 Arm-based 72-core Grace CPUs, and 36 BlueField DPUs per rack. Each GB300 NVL72 rack delivers 1.1 ExaFLOPS of dense FP4 inference and 0.36 ExaFLOPS of FP8 training performance, which is 50% higher compared to a GB200 NVL. In addition, each GB300 NVL72 rack features 20 TB of HBM3E and 40 TB of total RAM. Finally, the new rack-scale solution relies on Nvidia's Quantum-X800 InfiniBand switches and ConnectX-8 SuperNICs for scale-out connections at up to 14.4 GB/s, twice as fast than previously. These densely configured systems built for maximized training and inference performance are liquid cooled due to their extreme power consumption (up to 1,400W per GPU). "Dell's delivery of Nvidia GB300-powered solutions is more than a milestone," a statement from the company reads. "It reflects the trust our customers and partners continue to place in our expertise. By seamlessly engineering the compute, the network and the storage under one roof and fine-tuning with integration and deployment services, we help our customers move at unprecedented speed and scale. It is the continued innovation and speed that only we can execute that is allowing us to empower incredibly cool customers and accelerate work with partners like CoreWeave, Nvidia and many others." Dell noted that the rack-scale systems come assembled and tested as well as are designed for fast installation and deployment for production use. This is the second time when Dell and CoreWeave deploy Nvidia's latest AI GPU platform ahead of the industry. This achievement results from close work with Nvidia combining hardware, software, and services into integrated offerings that can be rapidly deployed. The deployment will enable CoreWeave to enhance its cloud platform to handle more advanced large language model training, reasoning processes, and inferencing. As CoreWeave employs more GB300 NVL72-based racks, total performance available to its customers will increase. One interesting thing to note is that Dell and CoreWeave deploy GB300 NVL72 racks just about seven months after they deployed the first GB200 NVL72 machines, which raises a question about longevity of the original GB200 platform (which was of delayed by a bit, but still). From CSPs point of view, it makes more sense to invest in higher-performance Blackwell Ultra machines than in the original Blackwell systems. So perhaps, there is quite some pent-up demand for Nvidia's Blackwell Ultra, so Nvidia will enjoy even more sales than it did in the first half of the year.

CoreWeave Gets First New, High-End Nvidia AI Chips From Dell

CoreWeave Inc. said it has received the market's first artificial intelligence server system based on the newest, high-end Nvidia Corp. chip, a sign of its rising stature in the competitive AI cloud-computing space. This first GB300 NVL72 rack of servers will be put together and deployed in the US, and CoreWeave plans to bring others online throughout the year, according to a statement from Dell Technologies Inc., which made the system. CoreWeave, whose customers include OpenAI, said the new system will let its clients "develop and deploy larger, more complex AI models that are exponentially faster than ever before."

CoreWeave is the first cloud provider to deploy Nvidia's latest AI chips

CoreWeave has received shipments of Dell-built shipments based around Nvidia's GB300 NVL72 AI systems, Dell said on Thursday. It's the first cloud provider to install systems based around Blackwell Ultra. The Blackwell Ultra is Nvidia's latest chip, expected to ship in volume during the rest of the year. The systems that CoreWeave is installing are liquid-cooled and include 72 Blackwell Ultra GPUs and 36 Nvidia Grace CPUs. The systems are assembled and tested in the U.S., Dell said. CoreWeave shares rose 6% during trading on Thursday, Dell shares were up about 2% and Nvidia rose less than 2%.

Dell unveils AI supercomputing system with Nvidia's advanced chips

The initial rollouts of both companies will include Dell Integrated Racks with 72 Blackwell Ultra GPUs, 36 Arm-based 72_Core Grace CPUs, and 36 BlueField DPUs per rack. These complex systems are designed for maximized training and inference performance, so they need to be liquid cooled due to their excessive power consumption. "Dell's delivery of Nvidia GB300-powered solutions is more than a milestone," a statement from the company said. "It reflects the trust our customers and partners continue to place in our expertise. By seamlessly engineering the compute, the network and the storage under one roof and fine-tuning with integration and deployment services, we help our customers move at unprecedented speed and scale," it continued. Using the latest GB300 series chip allows CoreWeave to handle more language learning model training, reasoning processes, and inferencing. The company currently deploys more GB300-NVL-based racks, so total performance is touted to increase. CoreWeave also has top-notch companies like OpenAI as its customers. They aim to 'develop and deploy larger, more complex AI models that are exponentially faster than ever before.'