Raja Koduri's Oxmiq Labs Unveils Revolutionary GPU IP for AI and Graphics

Legendary GPU architect Raja Koduri's new startup leverages RISC-V and targets CUDA workloads -- Oxmiq Labs supports running Python-based CUDA applications unmodified on non-Nvidia hardware

Another startup developing GPUs that are not meant for graphics emerges from stealth mode. Raja Koduri, a legendary GPU architect from ATI Technologies, AMD, Apple, and Intel, on Tuesday said he had founded a new GPU startup that emerged from stealth mode today. Oxmiq Labs is focused on developing GPU hardware and software IP and licensing them to interested parties. In fact, software may be the core part of Oxmiq's business as it is designed to be compatible with third-party hardware. Oxmiq develops a vertically integrated platform that combines GPU hardware IP with a full-featured software stack aimed at AI, graphics, and multimodal workloads where explicitly parallel processing is beneficial. On the hardware side, Oxmiq offers a GPU IP core based on the RISC-V instruction set architecture (ISA) called OxCore, which integrates scalar, vector, and tensor compute engines in a single modular architecture and can support near-memory and in-memory compute capabilities. Oxmiq also offers OxQuilt, a chiplet-based system-on-chip (SoC) builder that enables customers to create their own SoCs that integrate compute cluster bridge (CCB, which probably integrates OxCores), memory cluster bridge (MCB), and interconnect cluster bridge (ICB) modules based on specific workload requirements in a rapid and cost-efficient manner. For example, an inference AI accelerator for edge applications can pack a CCB and an ICB or two, an inference SoC requires more CCBs, MCBs, and ICBs, whereas a large-scale SoC for AI training can pack dozens of chiplets. Oxmiq does not disclose whether its OxQuilt enables building only multi-chiplet system-in-packages (SiP), or is designed to assemble monolithic processors too. Oxmiq's software stack is perhaps an even more important product that the company has to offer. The software package is designed to abstract the complexity of heterogeneous hardware and enable deployment of AI and graphics workloads across a range of hardware platforms, not just those using the company's IP. The core of the software stack is OXCapsule, a unified runtime and scheduling layer that manages workload distribution, resource balancing, and hardware abstraction. The layer encapsulates applications into self-contained environments, which the company calls 'heterogeneous containers.' These containers are designed to operate independently of the underlying hardware, enabling developers to target CPUs, GPUs, and AI accelerators without modifying their codebase or dealing with low-level configuration. A standout component of this stack is OXPython, a compatibility layer that translates CUDA-centric workloads into Oxmiq's runtime and allows Python-based CUDA applications to run unmodified on non-Nvidia hardware without recompilation. OXPython will first launch not on Oxmiq's IP, but on Tenstorrent's Wormhole and Blackhole AI accelerators. In fact, Oxmiq's software stack is fundamentally designed to be independent from Oxmiq hardware, and that is a core part of its strategy. "We are excited to partner with Oxmiq on their OXPython software stack," said Jim Keller, CEO of Tenstorrent. "OXPython's ability to bring Python workloads for CUDA to AI platforms like Wormhole and Blackhole is great for developer portability and ecosystem expansion. It aligns with our goal of letting developers open and own their entire AI stack." Having developed graphics processors at S3 Graphics, ATI Technologies, AMD, Apple, and Intel, Raja Koduri is primarily known as a GPU developer. In fact, he even positions Oxmiq as the first GPU startup in Silicon Valley in decades. "We may be the first new GPU startup in Silicon Valley in 25+ years," wrote Koduri in an X post. "GPUs are not easy." However, it should be noted that Oxmiq is not building a consumer GPU like AMD Radeon or Nvidia GeForce. In fact, it does not develop all the IP blocks necessary to build a GPU, unlike Arm or Imagination Technology: it does not support full consumer graphics features out-of-the-box (such as texture units, render back ends, display pipeline, ray tracing hardware, DisplayPort or HDMI outputs), so Oxmiq licensees must implement them in silicon themselves, if they plan to build a GPU. Oxmiq has secured $20 million in seed funding from major tech investors, including mobile and custom AI silicon developer MediaTek, and has already recorded its first software revenue. By focusing on IP licensing instead of costly chip production or even actual silicon implementation, the company maintains high capital efficiency without relying on expensive EDA tools or tape-outs. "Oxmiq has an impressive bold vision and world-class team," said Lawrence Loh, SVP of MediaTek. "The company's GPU IP and software innovations will drive a new era of compute flexibility across devices, from mobile to automotive to AI on the edge."

Chip startup Oxmiq launches GPU tech for license

SAN FRANCISCO, Aug 5 (Reuters) - Oxmiq Labs said on Tuesday that it planned to launch licensable graphics processor tech geared for artificial intelligence data crunching. Founded by Intel's (INTC.O), opens new tab former chief architect, Raja Koduri, Oxmiq said that it has raised $20 million in seed capital to help launch the new GPU intellectual property. The funding round includes investments from angel investors, and corporate strategic investors, including MediaTek (2454.TW), opens new tab, Oxmiq said. The company did not disclose its valuation. Oxmiq's GPU technology is capable of scaling from a single core for physical AI applications such as robotics, to thousands of cores that would be useful in a cloud computing company's data center. The company said it can customize the GPU architecture for specific types of computing. "We want to be Arm for the next generation," Koduri told Reuters. The Campbell, California-based company said it was taking a software-first approach to constructing its chip designs and has built a tool to allow software programs written for Nvidia's (NVDA.O), opens new tab CUDA to work on non-Nvidia hardware "without code modification of recompilation." The company said it opted to pursue building intellectual property instead of a complete chip design because it would avoid the high costs. A cutting-edge chip can cost more than $500 million to design. At Intel, Koduri oversaw the development of the company's graphics chips. Koduri has held senior positions at Advanced Micro Devices (AMD.O), opens new tab and Apple (AAPL.O), opens new tab. Reporting by Max A. Cherney in San Francisco; Editing by Mrigank Dhaniwala Our Standards: The Thomson Reuters Trust Principles., opens new tab * Suggested Topics: * Technology Max A. Cherney Thomson Reuters Max A. Cherney is a correspondent for Reuters based in San Francisco, where he reports on the semiconductor industry and artificial intelligence. He joined Reuters in 2023 and has previously worked for Barron's magazine and its sister publication, MarketWatch. Cherney graduated from Trent University with a degree in history.

Ex-Intel and AMD graphics chief Raja Koduri promises a RISC-V based IP that 'rearchitects the GPU from first principles' but with few details in the startup word-salad

Tech startups are nothing new, but this one might stand a chance of making it because of who's behind it. These days, it seems like there's a new tech startup company appearing every day, promising to revolutionise whatever market it's targeting. Oxmiq Labs Incorporated is a name that few will have heard of right now, but its founder is practically a household name in the world of processors, and Raja Koduri's latest venture is making some big claims. Admittedly, those claims are so packed full of tech buzzwords that I had to reread them all a dozen times to get any sense of what makes Oxmiq Labs different from any other chip startup. "Oxmiq delivers solutions that balance multimodal computing flexibility with the radical performance improvements required for next-generation graphics and AI workloads for its customers," says the press announcement at Business Wire. It gets better: "Oxmiq's licensable GPU IP rearchitects the GPU from first principles incorporating breakthrough technologies including nano agents in silicon leveraging RISC-V cores, near-memory and in-memory computing, and light transport." Got all that? Good. Unfortunately, there's not a whole lot of additional, concrete information with which to explore whether any of those claims have any weight to them. Oxmiq has a single diagram to explain its new GPU IP (intellectual property), but even that's pretty vague. At the heart is the OxCore, of which almost nothing is said, other than it's based on the RISC-V ("risk-five") architecture and that it "integrates scalar, vector, and tensor compute engines in a modular architecture customizable for specific workloads, enabling nano-agents, native Python acceleration, and compatibility with SIMD/CUDA paradigms." These cores are designed to be stacked on top of a slice of relatively slow but spacious DRAM or relatively fast but small SRAM, with the resulting chiplets labelled as MCBs and CCBs in the diagram. What do the letters stand for, you might ask? That's not explained, but I'd guess they're something along the lines of memory/cache core something. Bonds, badgers, burgers, boffins -- not a clue. Anyway, each MCB/CCB is a complete SoC (system-on-chip), with interconnect bridges to allow them to be hooked up to other chiplets. Oxmiq's diagram shows two such examples: a MCB-heavy variant for doing AI inference and MCB/CCB-balanced version for AI training. Despite the press statement mentioning "next-generation graphics", this product absolutely is not for gaming PCs, sadly -- it's for massive data centers, to process AI or scientific data. To compete against AMD, Intel, and Nvidia, any hardware startup needs to have a comprehensive and powerful software stack, and to that end, Oxmiq has developed OXPython. This "enables Python-based Nvidia CUDA AI applications to execute seamlessly on non-NVIDIA hardware without code modification or recompilation." I'm not sure Nvidia would be best pleased about this, but another famous tech person startup certainly is: Jim Keller. His Tenstorrent company -- which also makes RISC-V processors for AI -- has teamed up with Oxmiq: "We're excited to partner with Oxmiq. OXPython's ability to bring Python workloads for CUDA to AI platforms like Wormhole and Blackhole is great for developer portability and ecosystem expansion. It aligns with our goal of letting developers open and own their entire AI stack." Keller and Koduri both have very long careers in the semiconductor industry, with Keller spending many years at AMD, leading the development of the Athlon K8 and Ryzen Zen architectures. Koduri also spent a long time at AMD, working in its graphics division, leading the development of Polaris, Vega (below), and Navi. He also spent time with Intel, with the Arc series of GPUs coming under his leadership. In short, both know what they're doing, and their names will certainly help in no small way with attracting investors. Tenstorrent does have one advantage over Oxmiq, though. It already has hardware available to buy, whereas Koduri's startup appears to be focused on IP only, i.e. it'll be down to another company to license the tech and make the chips themselves. That's more cost-effective than having to purchase fabrication slots at the likes of TSMC, but as Arm will testify, processor IP licensing isn't necessarily an easy path to big bucks. MediaTek has already invested in Oxmiq, though how much of the $20 million in seed funding it contributed to is unknown. Koduri's company claims to have already generated revenue from its software (Tenstorrent will certainly be responsible for some of this) and that area might ultimately be its biggest earner. The G in GPU might stand for graphics, but the money just doesn't lie in gaming anymore (and hasn't for a good few years). Calling them AIPUs might seem like a silly idea, but at least it would stop anyone from unrealistically hoping that Nvidia's near-monopoly of the gaming GPU industry was under threat from a potent startup. The possibility of Oxmiq's 'rearchitected GPUs' prising AI revenue away from Team Green might be a little more believable, though.

Raja Koduri returns to the GPU business with new startup called Oxmiq Labs

TL;DR: Oxmiq Labs, founded by ex-RTG and Intel GPU architect Raja Koduri, is revolutionizing AI GPU design with a software-first, transistor-level approach. Leveraging 500+ years of expertise and hundreds of patents, Oxmiq focuses on GPU IP development to enable flexible, high-performance AI hardware across diverse platforms. A new GPU startup has just been born in Silicon Valley, one of the first in the last 25 years or so, with the ex-RTG boss announcing his new startup -- Oxmiq Labs -- and they've got world-class architects to make AI GPUs. Koduri retired from Intel as its Chief GPU architect close to two years ago, previously working for AMD as the Senior VP and Chief GPU Architect of its graphics department -- Radeon Technologies Group (RTG) -- but is now building AI GPUs from scratch with Oxmiq Labs. Oxmiq Labs will represent 500+ years of collective experience and will use hundreds of patents to design new AI hardware, with the company not just tweaking current GPU designs, but rather will be rebuilding the GPU ecosystem from the ground up with an "Atoms to Atoms" mindset. This will see the development of low-level hardware and bring transistor-level innovation to create high-end AI systems. The new GPU startup will be taking a software-first approach to constructing its AI chip designs and has designed a tool to allow software programs written for NVIDIA CUDA to work on non-NVIDIA hardware "without code modification or recompilation". Oxmiq has decided to pursue building IP instead of a complete chip design because it wanted to avoid the high costs associated with building cutting-edge chips, which can cost over $500 million to design. Jim Keller, CEO of Tenstorrent, said: "We're excited to partner with OXMIQ on their OXPython software stack. OXPython's ability to bring Python® workloads for CUDA to AI platforms like Wormhole™ and Blackhole™ is great for developer portability and ecosystem expansion. It aligns with our goal of letting developers open and own their entire AI stack". Lawrence Loh, SVP of MediaTek, added: "OXMIQ has an impressive bold vision and world-class team. The company's GPU IP and software innovations will drive a new era of compute flexibility across devices - from mobile to automotive to AI on the edge".

Chip startup Oxmiq launches GPU tech for license - The Economic Times

Founded by Intel's former chief architect, Raja Koduri, Oxmiq said that it has raised $20 million in seed capital to help launch the new GPU intellectual property.Oxmiq Labs said on Tuesday that it planned to launch licensable graphics processor tech geared for artificial intelligence data crunching. Founded by Intel's former chief architect, Raja Koduri, Oxmiq said that it has raised $20 million in seed capital to help launch the new GPU intellectual property. The funding round includes investments from angel investors, and corporate strategic investors, including MediaTek, Oxmiq said. The company did not disclose its valuation. Oxmiq's GPU technology is capable of scaling from a single core for physical AI applications such as robotics, to thousands of cores that would be useful in a cloud computing company's data center. The company said it can customize the GPU architecture for specific types of computing. "We want to be Arm for the next generation," Koduri told Reuters. The Campbell, California-based company said it was taking a software-first approach to constructing its chip designs and has built a tool to allow software programs written for Nvidia's CUDA to work on non-Nvidia hardware "without code modification of recompilation." The company said it opted to pursue building intellectual property instead of a complete chip design because it would avoid the high costs. A cutting-edge chip can cost more than $500 million to design. At Intel, Koduri oversaw the development of the company's graphics chips. Koduri has held senior positions at Advanced Micro Devices and Apple.

Raja Koduri Is Back In The GPU Business, Unveils New Startup, Oxmiq Labs, Bringing 500 Years Of Combined Experience Via World-Class GPU & AI Architects

Intel's ex-chief of the GPU department begins his new journey at Oxmiq Labs, bringing world-class architects to deliver AI GPUs from scratch. Raja Koduri Begins His New GPU Startup, Rebuilding the Entire GPU Ecosystem From Scratch, Prioritizing "Software First" Strategy to Enable Unmodified Python-Based CUDA Apps to Run on Non-NVIDIA Hardware Roughly two years after retirement from Intel, the ex-chief GPU architect, Raja Koduri, who has previously worked for AMD as a SVP and Chief GPU Architect in the graphics department, is now on his new venture of producing AI GPUs from scratch. Raja founded a new startup called Oxmiq Labs, which will now leverage the experience of world-class GPU and AI architect veterans. As per the press release, the company will now represent 500 years of collective experience and will utilize hundreds of patents to work on new AI hardware, which will be built from the ground up. Oxmiq won't just tweak the current GPU designs but will rebuild the entire GPU ecosystem from scratch with the "Atoms to Agents" mindset, developing low-level hardware and bringing transistor-level innovation to developing high-level AI systems. With the increasing demands of multimodal AI, where various types of data such as text, images, and video interact in real time, GPUs with the capability to process these forms of data simultaneously and intelligently are the need of the hour. Since GPUs are flexible and programmable, unlike AI chips which serve a limited and specific task, Oxmiq's architecture aims to leverage that flexibility but improve the perfomrance and efficiency significantly. Through hardware innovations such as OXCORE, which is a modular GPU core bringing Scalar, Vector, and Tensor units for various operations, Oxmiq will be delivering support for nano agents, Python acceleration, and CUDA/SIMD compatibility. OXCORE will be able to scale from tiny devices all the way to large data centers. The OXCORE will utilize the OXQUILT chiplet architecture, which will enable the manufacturing of customized GPUs by mixing compute, memory, and interconnect components in the right ratio. This will help in the reduction of R&D and production time/costs compared to the traditional GPUs. However, as mentioned previously, Oxmiq's "Software First" strategy will be crucial to build an easy-to-use software stack, which will be compatible with both Oxmiq's GPU IP and third-party AI hardware like Tenstorrent. We're excited to partner with OXMIQ on their OXPython software stack, OXPython's ability to bring Python® workloads for CUDA to AI platforms like Wormhole™ and Blackhole™ is great for developer portability and ecosystem expansion. It aligns with our goal of letting developers open and own their entire AI stack. - Jim Keller, CEO of Tenstorrent Through its flagship software called OXPython, it will allow NVIDIA CUDA applications to run on non-NVIDIA hardware without modifying the code, and will be utilized on Tenstorrent AI chips first. That said, Oxmiq's unified software ecosystem, called OXCapsule, will further help developers deploy the AI apps across many platforms by hiding the complexity of hardware. OXMIQ has an impressive bold vision and world-class team, The company's GPU IP and software innovations will drive a new era of compute flexibility across devices - from mobile to automotive to AI on the edge. - Lawrence Loh, SVP of MediaTek That said, Oxmiq's strategy will be a licensing-first model, which will offer its IP licenses to others without having to build and sell full-fledged GPUs, avoiding the expensive tape-out process. Oxmiq has already raised $20 million in seed funding from companies like Mediatek, and it will be interesting to see the progress of this GPU startup, particularly when Raja claims that it is the first GPU startup in Silicon Vallenty in over 25 years.

GPU Visionary Raja Koduri Launches OXMIQ Labs to Redefine AI and Graphics Computing

OXMIQ takes a Software First approach, focusing on developer experience through a unified stack that works across both OXMIQ silicon and third-party GPU and AI platforms. Raja Koduri, announced the launch of OXMIQ Labs Inc., a new GPU software and IP powerhouse set to transform AI and graphics computing globally. OXMIQ emerges from two years of stealth R&D with a world-class team holding 500+ years of combined GPU & AI experience, hundreds of patents, and over $100B in past product revenue impact. The company's mission: to re-architect GPUs for the multimodal AI era, where text, images, audio, video, and 3D worlds work together seamlessly.