Huawei Challenges NVIDIA's Dominance by Open-Sourcing AI GPU Software Toolkit

Huawei is making its Ascend AI GPU software toolkit open-source to better compete against CUDA

Huawei is getting better at making AI GPUs. Now it wants to increase adoption of its technology on the software side Huawei has greenlit a plan to open-source its CANN software toolkit for its Ascend AI GPUs. According to the South China Morning Post, Huawei is making this move in order to better compete against Nvidia and its closed-source CUDA software ecosystem. Open-sourcing CANN, or Compute Architecture for Neural Networks, could further speed up developer innovation and improve the usability of Huawei's Ascend AI GPUs. Furthermore, Huawei has reportedly already held talks with China's leading AI players, business partners, universities, and research institutions on how to build an open-sourced Ascend ecosystem. CANN is a heterogeneous computing architecture that provides multi-layer programming interfaces to help users build AI applications tailored to Huawei's Ascend AI GPUs. At a high level, it's Huawei's version of CUDA, which provides the same interfaces for Nvidia GPUs. Huawei's decision to open-source its CANN software kit could further enhance China's effort to build self-sufficiency from Western chipmakers and help incentivize developers to build software for its Ascend AI GPUs. The performance of those chips is catching up to Nvidia's Blackwell B-series GPUs in the right environment. Nvidia is notorious for keeping its CUDA programming language a closed-off "moat" or "swamp", a trait that has been a key frustration for developers for years. CUDA is a tightly bound ecosystem that has very little support beyond Nvidia's own hardware, forcing developers to use Nvidia GPUs exclusively if they want to build software in CUDA. There have been initiatives like ZLUDA that have attempted to bring CUDA functionality to other GPU vendors (through a translation layer), but they have largely been unsuccessful due to pushback by Nvidia. Nvidia banned the use of translation layers in 2024, starting with CUDA version 11.6. Making CANN open-source could provide Huawei with an accelerated avenue to adoption for its homebrewed software toolkit. However, it will likely take years before CANN will approach the maturity of CUDA, which has been around for nearly 20 years and has been constantly updated since its release.

Huawei releases AI toolkit to weaken NVIDIA's hold on developers

Huawei Ascend AI chip is on display during a Huawei Data Infrastructure Summit. Huawei Technologies is opening up its core AI development toolkit, CANN. The Compute Architecture for Neural Networks powers applications built for the company's Ascend AI chips. By making it open-source, Huawei hopes to attract more developers and challenge NVIDIA's dominance, just as Beijing seems to be turning up the heat on the US chip giant. "This will speed up innovation from developers and make Ascend easier to use," said Eric Xu Zhijun, Huawei's rotating chairman, at the company's developer conference in Beijing on Tuesday.