Google Teams with AMD on 10th-Generation TPU Project for Reinforcement Learning Workloads

Google reportedly taps AMD to design next-generation TPU -- hybrid AI ASIC could integrate on-package CPU cores for reinforcement learning

Google has teamed up with AMD to develop one of its 10th-generation TPUs, according to a note by SemiAnalysis (via Sean). Analysts at SemiAnalysis believe Google may be interested in AMD's CPU cores for CPU-heavy workloads. If accurate, the collaboration would mark AMD's first major involvement in a custom AI ASIC project and could indicate that Google is exploring a new kind of TPU that combines its proprietary accelerator technology with on-board general-purpose cores for CPU-heavy workloads. "Market chatter suggests [Google] is working with AMD on a TPU project in the v10 generation," a SemiAnalysis note for clients cited by Sean reads. "AMD's involvement would be the first real involvement in a custom AI ASIC project, despite having a custom silicon team. AMD has strong IP, especially in advanced packaging and SoIC. Additionally, CPU IP could also be a draw given Google and its customers are pushing for TPUs with on-package CPU cores for RL workloads." Having developed nine generations of its proprietary AI accelerators (with Broadcom acting as actual silicon designer) and possessing extensive expertise in accelerator architecture, Google hardly needs AMD to design a conventional TPU. Hence, chances that AMD will implement Google's TPU v10i for inference or V10t for training are low. Hence, Google might need something only a CPU maker like AMD could provide, including CPU IP, programmable logic, interconnects, or certain advanced packaging know-how. Of these, the CPU angle is particularly noteworthy. SemiAnalysis claims that Google and its customers are pushing for TPUs with on-package CPU cores for reinforcement learning and potentially other CPU-heavy workloads. While conventional LLM training remains overwhelmingly accelerator-heavy, reinforcement learning for reasoning and agentic models can require considerably more general-purpose compute around accelerator operations. Google has already begun to increase CPU resources around its latest inference-oriented TPUs. Its TPU 8i systems, designed for inference, reasoning, and RL workloads, feature one Google Axion CPU for every two TPUs. By contrast, servers running Google's 7th Generation TPUs used one Xeon 'Emerald Rapid' processor for every four TPUs. Furthermore, we are hearing that in some cases a 1:1 ratio of CPUs to accelerators is optimal, so the future of AI may be way more CPU-heavy than we think. Meanwhile, bringing CPU cores directly into the TPU package could be a logical next step, as reducing the distance between general-purpose and tensor compute can improve performance and reduce power consumption. This is where AMD comes into play, as it already has experience developing a data center-grade design -- the Instinct MI300A -- that packs both x86 and accelerator chiplets. A hypothetical Google design could therefore combine Google-developed TPU compute chiplets with AMD CPU and HBM in a tightly integrated package built by AMD. Perhaps, Intel would appear as another potential candidate given that Google and Intel have multiple strategic collaborations. Yet Intel has no experience building hybrid x86+accelerator data center designs. Note that for now we are speculating and our analysis may be inaccurate. For now, the nature of AMD's alleged involvement remains unclear. Yet, if the report is indeed accurate, the important development may not be that AMD is helping Google build another TPU. Instead, what matters is that Google is considering a new CPU-heavy member of its TPU v10 family, optimized specifically for RL and agentic workloads, and is using AMD as a provider of some of the building blocks needed to create it. Follow Tom's Hardware on Google News, or add us as a preferred source, to get our latest news, analysis, & reviews in your feeds.

Google reportedly taps AMD for 10th-generation TPU project

Google is working with AMD on a 10th-generation Tensor Processing Unit project, according to a client note from semiconductor research firm SemiAnalysis cited by Tom's Hardware. The note said "market chatter suggests" Google is working with AMD on a TPU project in the v10 generation. Neither Google nor AMD has publicly commented, and the scope of AMD's role remains unclear. The reported collaboration would mark AMD's first major involvement in a custom AI accelerator project. Analysts said AMD's appeal lies in its CPU intellectual property, advanced packaging expertise, and experience building hybrid designs that combine x86 processors with AI accelerators in a single package. Google has developed nine generations of TPUs with Broadcom as the primary silicon designer. Google also has a long-term supply agreement with Broadcom that runs through at least 2031. Analysts said that history makes it unlikely AMD would design a conventional training or inference TPU. Instead, Google appears to be exploring a variant that places general-purpose CPU cores alongside tensor compute chiplets in the same package. SemiAnalysis said the design rationale is tied to reinforcement learning and agentic AI workloads, which require more general-purpose compute than standard large language model training. Google has already increased CPU resources in TPU 8i systems by pairing one Google Axion CPU with every two TPUs, double the ratio used with seventh-generation hardware. SemiAnalysis said some configurations may require a 1:1 CPU-to-accelerator ratio. AMD's Instinct MI300A already integrates x86 and accelerator chiplets in a single package.