Curated by THEOUTPOST
On Sat, 27 Jul, 12:02 AM UTC
2 Sources
[1]
NVIDIA Expected To Offer "US-Compliant" GB20 Blackwell AI Servers To China
NVIDIA now looks to offer "US-compliant" Blackwell GB20 AI servers to China in an attempt to capitalize on rising demands. Well, it looks like Team Green is determined to consolidate its position in the Chinese markets, and the firm intends to achieve this by offering its next generation of Blackwell products in the region. Recently, we reported on how NVIDIA is preparing for the "B20 AI GPU", which will be a successor to the firm's H20 AI GPU, which was originally designed in an attempt to comply with US export regulations. This shows that NVIDIA is seeing enormous interest in its Blackwell architecture from China, which is why they have now decided to design a China-specific AI server as well. The news comes from The Information, citing supply chain sources, that NVIDIA has decided to offer Blackwell AI servers to Chinese customers, which are compliant with the regulations imposed by the Biden administration. The AI server is likely going to be called the "GB20", which will be offered alongside the B20 AI GPUs to provide a complete package to customers. While figures related to performance haven't been disclosed yet, it is said that the Blackwell generation will provide decent capabilities to Chinese customers despite them getting "downgraded variants." It looks like while the Hopper generation was all about AI accelerators, the Blackwell architecture will see a much wider adoption for its server offerings, given that companies are now focusing on creating giant AI clusters, to achieve maximum compute power. Similar is the case with Chinese AI-focused firms as well, and a recent report disclosed that the region's server markets are expected to grow tremendously, reaching up to $16 billion in valuation by 2027, and by the looks of it, Blackwell's servers will play a vital role. The restrictions from the US haven't bothered NVIDIA & its Chinese customers at all, since Team Green has come up with alternatives, by providing regulation-compliant products to satisfy both parties. With the GB20 expected to debut in Chinese markets soon, we will see a new wave of AI advancement in the country, and for NVIDIA, well, a new and wide revenue stream.
[2]
Nvidia and partners could charge up to $3 million per Blackwell server cabinet -- analysts project over $200 billion in revenue for Nvidia
According to a report from Morgan Stanley cited by United Daily News, Nvidia and its partners will charge roughly $2 million to $3 million per AI server cabinet equipped with Nvidia's upcoming Blackwell GPUs. The industry will need tens of thousands of AI servers in 2025, and their aggregate cost will exceed $200 billion. So far, Nvidia has introduced two 'reference' AI server cabinets based on its Blackwell architecture: the NVL36, equipped with 36 B200 GPUs, which is expected to cost from $2 million ($1.8 million, according to previous reports), and the NVL72, with 72 B200 GPUs, which is projected to start at $3 million. NVL36 and NVL72 server cabinets (or PODs) will be available not only from Nvidia itself as well as its traditional partners, such as Foxconn, the world's largest supplier of AI servers, Quanta, and Wistron but also from newcomers, such as Asus. Assuming that Nvidia's partner TSMC can produce enough B100 and B200 GPUs using its 4nm-class lithography process technology and packaged using its chip-on-wafer-on-substrate (CoWoS) technology, availability from newcomers should ease the tight supply of actual Blackwell-based machines. Based on the UDN report citing Morgan Stanley, Nvidia anticipates shipping between 60,000 and 70,000 B200 server cabinets, each priced between $2 million and $3 million next year. It translates to an estimated annual revenue of at least $210 billion from these machines, which means that companies like AWS and Microsoft will spend even more. It brings us to math by Sequoia Capital partner David Cahn, who believes that the AI industry has to earn around $600 billion to pay off machines and data centers. Demand for AI servers is setting records and will not slow down any time soon, which will benefit both makers of AI servers and developers of AI GPUs. Despite the influx of competitors, Nvidia's GPUs are set to remain the de facto standard for training and many inference workloads, which benefits the company. Based on talks with industry sources, the same Morgan Stanley report revealed that international giants such as Amazon Web Services, Dell, Google, Meta, and Microsoft will all adopt Nvidia's Blackwell GPU for AI servers. As a result, demand is now projected to exceed expectations, so Nvidia is prompted to increase its orders with TSMC by approximately 25%, the report claims.
Share
Share
Copy Link
NVIDIA is expected to offer US-compliant GB20 Blackwell AI servers to China, while facing potential high costs for Blackwell server cabinets. This development highlights the complexities of international tech trade and the increasing value of AI infrastructure.
NVIDIA, the leading GPU manufacturer, is reportedly planning to offer US-compliant GB20 Blackwell AI servers to the Chinese market. This move comes as the company navigates the complex landscape of US export regulations while maintaining its presence in one of the world's largest tech markets. According to sources, NVIDIA is likely to introduce these servers to China in the second half of 2024, potentially as early as Q3 1.
The GB20 servers are expected to be powered by NVIDIA's next-generation Blackwell GPU architecture, which succeeds the current Hopper architecture. These servers are designed to comply with US regulations, ensuring that NVIDIA can continue to serve the Chinese market without running afoul of export restrictions.
While NVIDIA works on maintaining its global market presence, reports suggest that the company and its partners might be setting a hefty price tag for their Blackwell server cabinets. Industry insiders speculate that these AI-focused server cabinets could cost up to $3 million each 2.
This high cost reflects the cutting-edge technology packed into these servers and the growing demand for powerful AI infrastructure. The price point also indicates the premium that companies are willing to pay for state-of-the-art AI computing capabilities.
The GB20 Blackwell AI servers are expected to offer significant performance improvements over their predecessors. While specific details are yet to be officially confirmed, industry experts anticipate that these servers will provide enhanced AI training and inference capabilities, crucial for advancing various AI applications across different sectors.
NVIDIA's strategy to offer compliant servers to China underscores the delicate balance tech companies must maintain in the current geopolitical climate. By adhering to US regulations while serving the Chinese market, NVIDIA aims to preserve its global leadership in AI hardware.
The high cost of Blackwell server cabinets also highlights the economic impact of advanced AI technologies. As businesses and research institutions invest heavily in AI infrastructure, the market for high-performance computing continues to grow, with NVIDIA positioned at the forefront.
The availability of US-compliant GB20 Blackwell AI servers in China could have significant implications for AI development in the region. It may enable Chinese companies and researchers to access cutting-edge AI hardware while complying with international regulations, potentially accelerating AI innovation and applications in various industries.
As the AI arms race continues to intensify globally, the introduction of these powerful servers in key markets like China could play a crucial role in shaping the future of AI technology and its applications worldwide.
NVIDIA's next-generation Blackwell AI GPUs are experiencing unprecedented demand, with the entire supply sold out for the next 12 months. Major tech companies are aggressively acquiring these GPUs, highlighting the intense competition in the AI hardware market.
6 Sources
NVIDIA prepares to launch its next-generation Blackwell GB200 AI servers in December, with major cloud providers like Microsoft among the first recipients. This move aims to address supply issues and meet the growing demand for AI computing power.
3 Sources
Nvidia is reportedly working on a modified version of its advanced H100 AI chip for the Chinese market, aiming to comply with U.S. export controls while maintaining its position in the lucrative Chinese AI sector.
22 Sources
Morgan Stanley analysts report robust demand for Nvidia's Hopper and Blackwell chips, projecting $10 billion in revenue from Blackwell alone in Q4 2024. This forecast underscores Nvidia's dominance in the AI chip market.
2 Sources
NVIDIA showcases its next-generation Blackwell AI GPUs, featuring upgraded NVLink technology and introducing FP4 precision. The company also reveals its roadmap for future AI and data center innovations.
4 Sources
The Outpost is a comprehensive collection of curated artificial intelligence software tools that cater to the needs of small business owners, bloggers, artists, musicians, entrepreneurs, marketers, writers, and researchers.
© 2024 TheOutpost.AI All rights reserved