11 Sources
[1]
AMD acquires AI chip startup Taalas to boost inference performance by etching models into silicon
In AMD's latest bid to upset Nvidia's dominance in AI hardware, the House of Zen has acquired AI chip company Taalas, which bakes model weights directly into silicon in a process that promises to boost inference performance by an order of magnitude or more. The deal, announced at market close on Thursday, appears to be framed in much the same context as Nvidia's $20 billion licensing deal with Groq last December: make high-performance "premium" inference services prized for AI agents, like code assistants, faster and cheaper to run. AMD didn't disclose the terms of the deal, but from what we understand, this is an actual acquisition rather than an acquihire. Founded in 2023 and based in Toronto, Taalas' approach to inference is radically different from conventional GPUs or the dataflow architectures that underpin Groq LPUs or Cerebras' waferscale accelerators. A model-specific integrated circuit The startup's chips don't rely on HBM to store the model weights but rather etch them directly into the silicon. In a sense, Taalas' chips are really model-specific integrated circuits or MSICs. Perhaps more importantly, Taalas' tech isn't just conceptual. In February, the startup revealed its first test chip fabbed on TSMC's 6nm process tech, which it called the HC1. Initial benchmarks saw the chip serve Meta's Llama 3.1 8B at a blistering 16,960 tokens a second -- when announced last February, that was 48x faster than Nvidia's GPUs and 8.5x faster than Cerebras' accelerators. While Llama 3.1 is ancient by today's standards, having made its debut all the way back in mid 2024, the reticle-sized chip was really intended to prove the concept. Taalas has been incredibly secretive about how its chips actually work, but we know its processors are comprised of two main regions: the mask-ROM recall fabric where model weights are etched, and the SRAM recall fabric where KV caches and fine-tuning adapters are stored. For its second-gen HC2 chip due out this summer, Taalas aims to boost parameter count to 20 billion parameters. That might not sound like much, but just like with GPUs for larger models, weights are simply distributed across multiple accelerators using pipeline parallelism. At 20 billion parameters per chip, you'd need just 50 accelerators to support a trillion-parameter model, and AMD just so happens to have a rack-scale compute platform and in-house system design team that can comfortably accommodate that. That's quite a bit more space and power efficient than Nvidia's recently unveiled LPX systems, which would need a few dozen GPUs and at least 2,000 Groq LPUs to serve the same model. From what we understand, AMD intends to pair its Instinct-based Helios racks with chips based on Taalas' tech, which implies a disaggregated architecture where compute-heavy prompt processing is done on GPUs while token generation is offloaded to Taalas-based accelerators. It's also possible that AMD could adopt a sort of tick-tock cadence in which customers initially deploy and validate models on Instinct accelerators and, once they're satisfied with them, transition to Taalas accelerators. We can only speculate at this point, but here's what AMD's SVP of AI, Vamsi Boppana, had to say about it in a canned statement: "AMD is building a full-stack AI platform that gives customers the flexibility to deploy the right compute solutions for every AI workload." You better really love that model While the tech is blazing fast, if you hadn't already figured it out, it comes with a pretty substantial downside. Once the chips are deployed you're stuck with that model. Any change bigger than something like a LoRA adapter is going to require a re-spin of the chips, which is not only expensive but time-consuming. Nearly four years into the AI boom, new models are rolling out on a nearly monthly basis. In order to benefit from Taalas' tech, AMD's customers are going to have to be really sure about their choice of models, which will be easier for some than others. However, if the startup is to be believed, the situation isn't quite as bad as it sounds. While new models will require a re-spin, it doesn't require starting over from scratch. Instead, just two layers of metal need to be changed, which is a lot cheaper and less time-consuming. With that said, we strongly suspect this tech will largely be deployed by AI model devs, their infrastructure providers, and a handful of inference providers. In an interview with our sibling site The Next Platform in February, the company suggested that etching a model's weights into silicon is 100x less expensive than training a frontier model. AMD is certainly in a position to negotiate those deals. OpenAI, Anthropic, and Meta are all major Instinct customers. Given the close working relationship between the model houses and the chip designer, it wouldn't be surprising to see a GPT or Claude deployed on a combination of Taalas and instinct accelerators. The tech also has implications for model development. One of the ways developers have cut down on hallucinations is by trading time for accuracy. The technique, called test-time scaling, is quite simple in practice, and involves allowing a model to "think" for longer before responding. One drawback of test-time scaling is that it consumes substantially more tokens, which makes it expensive, and means users have to wait longer for the chatbot, code assistant, or agent to respond. If AMD's Taalas buy can drive down the cost per token and boost output speeds by 10x or 20x, model devs may opt to extend the reasoning time even further. In any case, we may not have to wait long to see just how Taalas fits into AMD's broader vision. Subject to regulatory approval, the deal is expected to close in the fourth quarter. ®
[2]
AMD deepens AI inference bet with Taalas deal as chip race heats up
Aug 6 (Reuters) - Advanced Micro Devices (AMD.O), opens new tab said on Thursday it would buy chip startup Taalas for an undisclosed amount, strengthening its technology as it taps into the rapidly growing market for AI inference workloads. Toronto-based Taalas develops specialized silicon designed to reduce computing and memory bottlenecks in AI inference, the process of running trained AI models to generate responses or predictions. Specialized inference chips have become a â critical focus for semiconductor makers as AI shifts from training to real-time, high-volume deployment, and companies race to cut computing costs. Larger rival Nvidia (NVDA.O), opens new tab in March unveiled a new central processor and AI system built on technology from Groq, a chip startup specializing in inference. AMD plans to integrate Taalas' technology into its accelerator roadmap and develop system-level solutions using AMD Instinct graphics processing units (GPUs). "AMD is building a full-stack AI platform that gives customers the â flexibility to deploy the right compute solutions for every AI workload," Vamsi Boppana, senior vice president of AMD's Artificial Intelligence Group, said in a statement. Taalas' technology and engineering team strengthens AMD's AI portfolio by "delivering differentiated inference performance and â efficiency," Boppana added. Taalas, founded in 2023, had raised $169 million in February to support the development of chips optimized for AI models, bringing its total funding to around $219 million. AMD â has been bolstering its AI business through a string of acquisitions. In November, the company said it bought MK1, an AI software startup â specializing in high-speed inference. The company purchased MEXT to expand its AI portfolio in June and added FastFlowLM to its Artificial Intelligence Group in July. Reporting by Juby Babu in Mexico City; Editing by Sriraj Kalluvila Our Standards: The Thomson Reuters Trust Principles., opens new tab
[3]
AMD buys chip startup that hardwires AI models into its silicon
Advanced Micro Devices is counting on its graphics processing units to drive the bulk of its data center growth as cloud companies snap up all the advanced AI chips they can find. But as the generative artificial intelligence boom approaches its fourth anniversary, it's becoming clear that GPUs don't do everything. On Thursday, AMD said it's entered into an agreement to acquire Taalas, a Toronto-based startup that makes chips for inference. Taalas' accelerators are customized, or hard-wired for a single AI model, rather than being general purpose. In exchange for that loss of flexibility, Taalas' technology promises a less-expensive chip that it says can produce output for specific models thousands of times faster than a traditional GPU. An AMD representative declined to provide a purchase price for the transaction. Taalas has raised a total of $219 million in venture funding since its 2023 founding. The deal comes a little over seven months after Nvidia spent $20 billion buying assets from Groq, a designer of high-performance AI chips. It was Nvidia's largest transaction on record. Taalas' current chip runs a small version of Meta's Llama 3.1 model, though the company is working on chips for bigger and more advanced models. It's manufactured using an older TSMC process, and uses speedy SRAM memory on the chip itself. Taalas CEO Ljubisa Bajic says on the startup's website that the company "developed a platform for transforming any AI model into custom silicon." "From the moment a previously unseen model is received, it can be realized in hardware in only two months," Bajic wrote. Alternative chips like those from Taalas and Groq are particularly important for "low-latency" applications, where time to first response from an AI model is important. "I'm a big believer that there's no one-size-fits-all as it comes to chips," AMD CEO Lisa Su said at a product launch in July. She added that AMD still expects GPUs to make up the majority of the AI chip market because they're flexible enough to support newly developed AI models. Demand for GPUs has turned Nvidia into the world's most valuable company with a market cap of over $5 trillion. The acquisition also reflects the rising importance for leading GPU makers to offer integrated systems with several different components and chips instead of just processors. AMD recently started to ship Helios, its first rack-scale rival to Nvidia's integrated server racks, to customers including Meta and Microsoft. AMD said it would integrate the Taalas chips and technology into its roadmap, including in systems with its central processors and Instinct GPUs. It's not the only complimentary accelerator that AMD is supporting: In July, AMD announced a partnership with Cerebras to integrate its AI chips into its systems later this year. AMD has been on a buying spree to fill out some of the components and technologies it needs to build its Helios racks. In 2024, it paid $665 million for Silo AI, which develops AI models, and purchased ZT Systems, which provided the technical basis of its rack-scale products, for $4.9 billion. Last year, AMD bought several smaller AI companies, including MK1, which made software for inference.
[4]
AMD buys Taalas to etch AI models into silicon
AMD is buying Taalas, a Toronto startup that etches a single AI model permanently into a chip. The reward is blistering speed. The catch is that the chip can then run only that one model. AMD announced the deal on Thursday, after the market closed, and did not say what it paid. Taalas, founded in 2023, builds what it calls model-specific chips. Instead of loading weights from memory, it bakes them straight into the silicon. AMD says the technology will join its accelerator roadmap, working alongside its Instinct GPUs. "I'm a big believer that there's no one-size-fits-all as it comes to chips," AMD chief executive Lisa Su said at a July event. That line is the whole logic of the deal. The industry spent four years buying general-purpose GPUs. AMD is betting the next phase rewards something far narrower. What Taalas actually built A normal AI chip keeps memory and compute apart, then burns huge effort shuttling data between them. That gap is why modern systems need stacked memory, exotic packaging, and liquid cooling. Taalas merges the two. Its co-founder, Ljubisa Bajic, says the result needs none of it: no high-bandwidth memory, no 3D stacking, no liquid cooling. The speed claims are startling. Taalas's first chip runs Meta's Llama 3.1 model at about 17,000 tokens a second per user, which it says is many times faster than a leading GPU, at a fraction of the cost and power. Those are the company's own numbers. The first version also leans on aggressive compression that dents output quality. You had better love that model Here is the trade. Hardwire a model into a chip and you marry it. New models now arrive almost monthly, and a serious change means re-spinning the silicon. Taalas softens the blow: only two of the chip's metal layers need redoing, so a new model can be etched in about two months rather than six. Even so, buyers will have to be very sure of their pick. "You better really love that model," as The Register put it. In practice the customers are likely to be the big model labs and inference providers, the few players confident enough about a model to cast it in silicon. The bigger race AMD is not alone. The deal echoes Nvidia's $20bn Groq purchase in December, and Qualcomm's acquisition of the compiler startup Modular in July. Anthropic is building its own silicon team to shape hardware around its models. Everyone is converging on one idea: match the chip to the workload. For AMD, Taalas slots into a bigger push. It has spent the year assembling an inference stack around its Helios racks and signing gigawatt-scale deals with the likes of Anthropic and OpenAI. Those sell flexible GPUs by the gigawatt. Taalas offers the opposite: extreme efficiency for a model that has stopped moving. The purpose underneath is a challenge to Nvidia, whose general-purpose chips made it the world's most valuable company. As AI shifts from training models to serving them, that grip loosens a little. AMD has bet that the future of inference is narrow, fast, and etched in place. The deal is expected to close in the fourth quarter.
[5]
AMD acquires Taalas AI inference chip startup
The Toronto-based startup, founded in 2023, has raised $219 million and builds chips hardwired for specific AI models AMD $AMD announced Thursday it has entered into a definitive agreement to acquire Taalas, a Toronto-based startup that builds chips designed for AI inference. Financial terms were not disclosed. Founded in 2023, Taalas designs chips tailored to specific AI models instead of serving as all-purpose processors. The approach optimizes inference dataflows and reduces compute and memory bottlenecks, the company said. That specificity comes at a cost: each chip is locked to the model it was made for, so deploying a different model means commissioning entirely new silicon, according to SiliconAngle. Taalas says that constraint is less limiting than it sounds. Taalas notes that fewer than a handful of a chip's hundred-plus layers need to be altered from one design to another, and it estimates it can move from design to finished silicon in about two months with its proprietary tooling, according to SiliconAngle. Taalas' first chip ran a version of Meta $META's Llama 3.1 model. The startup has raised a total of $219 million in venture funding, according to CNBC. AMD said it plans to integrate Taalas' technology into its accelerator roadmap and develop system-level products alongside its Instinct GPUs, EPYC processors, Helios rack-scale platform, and ROCm software. "AMD is building a full-stack AI platform that gives customers the flexibility to deploy the right compute solutions for every AI workload," Vamsi Boppana, senior vice president of AMD's Artificial Intelligence Group, said in a statement. "Taalas' technology and world-class engineering team strengthen our AI portfolio by delivering differentiated inference performance and efficiency." Ljubisa Bajic, co-founder and CEO of Taalas, described the company's founding mission as one "to rethink AI inference from the ground up by building the hardware around the model." He added that joining AMD would provide the scale and resources needed to accelerate development. The acquisition adds to a string of AI-related deals AMD has made to build out its Helios rack systems. AMD reported record revenue of $11.5 billion in its most recent quarter, with its data center segment more than doubling year over year to $6.7 billion. The company has also secured Helios commitments from customers including Meta and Microsoft $MSFT, which agreed to deploy the rack-scale system on Azure to support frontier model inference. AMD stock rose about 1.5% following the announcement. The deal is subject to customary closing conditions and regulatory approvals.
[6]
AMD acquires Taalas to hardwire AI models into silicon
Advanced Micro Devices Inc. said today it has agreed to buy Taalas Inc., a Toronto startup that hardwires artificial intelligence models directly into silicon, in a deal that pushes the chipmaker deeper into the market for AI inference. Terms were not disclosed. AMD shares rose about 1.5% following the announcement. Founded in 2023, Taalas builds what it calls model-specific integrated circuits, chips that cast a model's weights and dataflow into transistors instead of shuttling them in and out of high-bandwidth memory. Its first test chip, HC1, was built on Taiwan Semiconductor Manufacturing Co. Ltd.'s 6-nanometer process and served Meta Platforms Inc.'s Llama 3.1 8B at close to 17,000 tokens per second, a rate Taalas said in February was 73 times that of Nvidia Corp.'s H200 at one-tenth the power. A second chip, HC2, targets models of about 20 billion parameters. The tradeoff is flexibility. A finished Taalas part runs the model it was built for and nothing else, so a new model means new silicon. Taalas says that is cheaper than it sounds. Only two of the chip's 100-plus layers change from one design to the next, and the company puts its tape-out time at roughly two months using in-house tools. The technology is headed for AMD's accelerator roadmap. The larger plan is systems, not just parts. AMD wants Taalas chips working next to its Instinct GPUs, wired into the Helios racks and Epyc processors it sells and programmed through its ROCm software. Vamsi Boppana, senior vice president of AMD's Artificial Intelligence Group, said the aim is choice, giving customers "the right compute solutions for every AI workload." Taalas brings what he called differentiated inference performance and efficiency. Taalas co-founder and Chief Executive Ljubisa Bajic is on his second AI chip company. He ran Tenstorrent Inc. before leaving to start Taalas. The startup was founded "to rethink AI inference from the ground up by building the hardware around the model," he said. His Toronto team joins Boppana's group when the deal closes. The purchase lands in a market that has reorganized itself around inference over the past year. Nvidia agreed in December to license inference technology from Groq Inc. in a reported $20 billion deal, then put it to work in the Groq 3 language processing unit unveiled at its GTC conference in March. Taalas is AMD's third AI acquisition in nine months, following MK1 in November and memory optimization startup Mext in June. The FastFlowLM team joined the company in July. Taalas raised $169 million in February from Quiet Capital, Fidelity and semiconductor investor Pierre Lamond, taking its total to about $219 million. The acquisition is subject to customary closing conditions and regulatory approvals.
[7]
AMD AI inference: AMD deepens AI inference bet with Taalas deal as chip race heats up
Toronto-based Taalas develops specialized silicon designed to reduce computing and memory bottlenecks in AI inference, the â process â of running trained AI models to generate responses or predictions. Advanced Micro Devices said on Thursday it would buy chip startup Taalas for an undisclosed amount, strengthening its technology as it taps into the rapidly growing market for AI inference workloads. Toronto-based Taalas develops specialized silicon designed to reduce computing and memory bottlenecks in AI inference, the â process â of running trained AI models to generate responses or predictions. Specialized inference chips have become a critical focus for semiconductor makers as AI shifts from training to real-time, high-volume deployment, and companies race to cut computing costs. Larger rival Nvidia in March unveiled a new central processor and AI system built on â technology from Groq, a chip startup specializing in inference. AMD plans to integrate Taalas' technology into its accelerator roadmap and â develop system-level solutions using AMD Instinct graphics processing units (GPUs). "AMD is building a full-stack AI platform that gives customers the flexibility to deploy the right compute solutions for every AI workload," Vamsi Boppana, senior vice president of AMD's Artificial Intelligence Group, said in a statement. Taalas' technology and engineering team strengthens AMD's AI portfolio by "delivering differentiated inference performance and efficiency," Boppana added. Taalas, founded in 2023, had raised $169 million in February to support the development of chips optimized â for AI models, bringing its total funding to around $219 million. AMD has been bolstering its AI business through a string of acquisitions. In November, the company said it bought MK1, an AI software startup specializing in high-speed inference. The company purchased MEXT to expand its AI portfolio in June and added FastFlowLM to its Artificial Intelligence Group in July. (Reporting by Juby Babu in Mexico City; Editing by Sriraj Kalluvila)
[8]
AMD Buys AI Chip Startup Taalas -- Here's Why It Matters To NVDA Investors - Advanced Micro Devices (NASDAQ:
Advanced Micro Devices (NASDAQ:AMD) said Thursday it will acquire Taalas, a Toronto startup that hardwires entire AI models directly into silicon, for an undisclosed amount. The deal targets inference, the business of running trained models, which AMD projects may grow more than 80% annually and where rival Nvidia Corp. (NASDAQ:NVDA) has already made its own specialization play. One Chip, One Model Taalas builds chips that do only one thing. Its first product, the HC1, runs Meta's Llama 3.1 8B and nothing else, because the model's weights are physically etched into the silicon. That sounds like a flaw, but it removes one of the biggest bottlenecks in AI inference. Ordinary GPUs must repeatedly shuttle billions of model weights between memory and compute, creating a major inference bottleneck. Taalas skips the trip entirely, so the model effectively becomes the processor. The payoff is speed. Taalas says the HC1 generates roughly 17,000 tokens per second per user, and EE Times saw more than 15,000 on the public demo. Nvidia's Blackwell hardware managed around 350 in Taalas' own testing. CEO Ljubisa Bajic, a Tenstorrent co-founder who spent years at AMD earlier in his career, told EE Times the company made "painful tradeoffs in flexibility for the sake of economics and speed." The Catch: The Chip Is the Model Switching to a different model still requires making new chips, but Taalas says almost the entire design can stay the same. Only a small part needs to be changed to encode the new model, and TSMC can reportedly manufacture the updated version in about two months. The reward for giving up flexibility could be cheap hardware. The company claims its system costs 20 times less to build and uses 10 times less power, partly because it needs no HBM, advanced packaging or liquid cooling, though those figures remain its own estimates. The obvious objection is that an 8-billion-parameter Llama model is small by today's standards. Taalas told Reuters in February it aimed to build silicon capable of running a frontier model such as GPT-5.2 by year-end. Why AMD Wants It Nvidia built its dominance on training, the expensive process of creating AI models. AMD is betting the bigger prize may be inference, the business of running those models for users, which it projects could grow more than 80% a year. Taalas is its fourth inference deal since November, after inference software firm MK1 and two smaller startups. The pieces feed into Helios, AMD's rack-scale answer to Nvidia. Microsoft last month agreed to deploy Helios on Azure to run frontier-model inference. For now, traders still back the incumbent. Polymarket gives Nvidia a 68% chance of ending 2026 as the world's most valuable company. Apple has fallen to about 36%. Taalas gives AMD a radically different answer to Nvidia: instead of making every chip run every model, make some chips extraordinarily good at running just one. Market News and Data brought to you by Benzinga APIs To add Benzinga News as your preferred source on Google, click here.
[9]
AMD Snaps Up Taalas Weeks After Cerebras Deal, Chasing Chips That Bake AI Models Into Silicon
Just a few weeks after AMD inked a deal with Cerebras to boost the inference capabilities of the upcoming Helios rack-scale system, it has acquired Taalas, a startup that designs chips specifically for inference-related workloads. Taalas bakes AI models directly into silicon chips, and AMD has just inked a definitive agreement to acquire it AMD has just signed an agreement to acquire Taalas in a move designed to complement its Helios systems. For the benefit of those might not be aware, Taalas eliminates the so-called memory wall - an increasingly common situation where the GPUs sit idle as they wait for the appropriate data to arrive to then start crunching numbers - by hardwiring a given AI model into individual transistors, courtesy of a proprietary digital architecture that is capable of storing 4 bits of data and executing math operations using a single transistor. Basically, Taalas HC1 chip features shared hardware blocks that permanently and constantly pre-compute all 16 possible products for a quantized 4-bit weight. Because every possible math outcome is already happening live across the chip, the individual transistor doesn't actually do any math but acts as a physical router. Here, each specific weight of the AI model is represented by a single Mask ROM transistor - during the manufacturing process, a microscopic physical wire (a metal layer mask) is etched to physically connect that transistor to one of the 16 pre-computed product lines. When data flows through the chip, the transistor simply selects the correct pre-calculated mathematical channel and passes it to the adder. Therefore, Taalas' HC1 chip is capable of generating an astonishing 16,000 to 17,000 tokens per second per user by using this setup. This approach is somewhat similar to the Groq LPU, which uses small isolated pools of the SRAM, and where AI model weights are hard-baked directly into the SRAM, completely bypassing the concept of a memory cache. AMD's decision to acquire Taalas complements its integration of the Helios system with Cerebras' Wafer-Scale Engine, which places an entire AI supercomputer's worth of memory and compute onto a single, giant, interconnected sheet of silicon, and where hundreds of thousands of compute cores and tens of GBs of SRAM connect seamlessly, allowing data to move efficiently without ever hitting external network bottlenecks. Follow Wccftech on Google to get more of our news coverage in your feeds.
[10]
AMD Acquires Taalas to Boost AI Inference Performance and Next-Gen Compute Solutions
Taalas' technology will complement AMD's full-stack AI platform, including AMD Helios rackscale solutions, AMD Instinct GPUs, AMD EPYC CPUs, AMD ROCm software and the company's expanding AI ecosystem. AMD announced it has reached a definitive agreement to acquire Taalas, a pioneer in specialized AI inference silicon. As AI inference becomes one of the fastest-growing segments of the AI market and workloads become increasingly specialized, the acquisition strengthens AMD's long-term AI roadmap with differentiated inference technology and world-class engineering expertise. Founded in 2023 and headquartered in Toronto, Canada, Taalas' technology optimizes inference dataflows, significantly reducing compute and memory bottlenecks associated with general-purpose architectures and enabling highly optimized AI inference capabilities. Taalas' technology will complement AMD's full-stack AI platform, including AMD Helios⢠rackscale solutions, AMD Instinct GPUs, AMD EPYC⢠CPUs, AMD ROCm⢠software and the company's expanding AI ecosystem. AMD plans to integrate the technology into its accelerator roadmap and develop system-level solutions with AMD Instinct GPUs. "AMD is building a full-stack AI platform that gives customers the flexibility to deploy the right compute solutions for every AI workload," said Vamsi Boppana, senior vice president of the Artificial Intelligence Group at AMD. "Taalas' technology and world-class engineering team strengthen our AI portfolio by delivering differentiated inference performance and efficiency." "We founded Taalas to rethink AI inference from the ground up by building the hardware around the model," said Ljubisa Bajic, co-founder and CEO of Taalas. "Our Canada-based team has combined deep technical expertise with a willingness to challenge conventional approaches. Joining AMD will give us the scale, engineering resources and global reach to accelerate our innovation." As AI moves into more real-time, high-volume applications, AMD and Taalas will help customers deploy inference workloads more efficiently across a growing range of applications. Positioned to accelerate AI innovation, the acquisition builds on AMD's long-standing presence in Canada - where the company has been a proud contributor to the country's semiconductor and AI ecosystem - and reflects a continued commitment to retaining and growing Canadian talent. The acquisition is subject to customary closing conditions and regulatory approvals.
[11]
AMD to Buy AI Chip Startup Taalas
AMD has reached a deal to buy the AI chip startup Taalas at undisclosed terms. AMD said that the deal would strengthen its long-term AI ambitions by adding a differentiated inference technology and engineering expertise. Founded in 2023 and based in Toronto, Taalas optimizes inference dataflows, helping to reduce compute and memory bottlenext associated with general-purpose architectures and enabling highly optimized AI inference capabilities. AMD said that Taalas' technology will complement AMD's full-stack AI platform. It eventually plans to integrate the technology into its accelerator roadmap and develop system-level solutions with AMD Instinct GPUs. The deal is subject to customary closing conditions and regulatory approvals.
Share
Copy Link
AMD acquired Toronto-based Taalas, an AI chip startup that hardwires model weights directly into silicon. The deal strengthens AMD's AI inference capabilities with technology that promises 48x faster performance than traditional GPUs, though chips remain locked to specific models.
AMD acquires Taalas, a Toronto-based startup that etches AI models into silicon, marking the chip giant's latest move to challenge Nvidia's dominance in AI hardware
1
2
. The deal, announced Thursday after market close, focuses on making high-performance AI inference services faster and cheaper to run. While AMD didn't disclose financial terms, the acquisition brings in a company that raised $219 million since its 2023 founding3
5
. The move mirrors Nvidia's $20 billion Groq licensing deal from December, signaling how seriously chipmakers now take specialized inference technology1
. Vamsi Boppana, AMD's senior vice president of AI, stated that "AMD is building a full-stack AI platform that gives customers the flexibility to deploy the right compute solutions for every AI workload"2
5
.
Source: Benzinga
Taalas developed what it calls model-specific integrated circuits that hardwire AI models into silicon rather than loading weights from memory
1
4
. The chips eliminate compute and memory bottlenecks by merging memory and compute functions directly into the silicon2
4
. According to Taalas co-founder Ljubisa Bajic, this approach eliminates the need for high-bandwidth memory, 3D stacking, or liquid cooling4
. The processors contain two main regions: a mask-ROM recall fabric where model weights are etched, and an SRAM recall fabric for KV caches and fine-tuning adapters1
. Taalas manufactured its first test chip, the HC1, on TSMC's 6nm process technology in February1
.
Source: The Register
The HC1 chip delivered remarkable inference performance when running Meta Llama 3.1 8B, achieving 16,960 tokens per secondâ48x faster than Nvidia GPUs and 8.5x faster than Cerebras accelerators at the time of announcement
1
3
. Taalas claims its technology can produce output for specific models thousands of times faster than traditional GPUs, though this comes at the cost of flexibility3
. The company's second-generation HC2 chip, due this summer, aims to support 20 billion parameters per chip1
. For larger models, weights can be distributed across multiple accelerators using pipeline parallelismâmeaning just 50 accelerators would support a trillion-parameter model1
.The technology's primary limitation is that once deployed, chips remain locked to a single model
3
4
. Any significant change beyond LoRA adapters requires a silicon re-spin, which adds cost and time1
. However, Taalas mitigates this constraint by requiring changes to only two metal layers rather than starting from scratch, allowing new models to be etched in about two months instead of six1
4
. Taalas notes that fewer than a handful of a chip's hundred-plus layers need alteration from one design to another5
. The company claims etching model weights into silicon costs 100x less than training a frontier model1
. This positions the technology for AI model developers, infrastructure providers, and inference services rather than general enterprise customers1
.
Source: Wccftech
Related Stories
AMD plans to integrate Taalas technology into its AI accelerator roadmap and develop system-level solutions using AMD Instinct GPUs, EPYC processors, and Helios rack-scale platform
2
5
. The company appears positioned to pair Instinct-based Helios racks with Taalas chips in a disaggregated architecture where compute-heavy prompt processing runs on GPUs while token generation offloads to Taalas accelerators1
. AMD could adopt a deployment strategy where customers initially validate models on Instinct accelerators before transitioning to Taalas accelerators for production1
. This approach offers far better space and power efficiency than Nvidia's LPX systems, which would need dozens of GPUs and at least 2,000 Groq LPUs to serve the same trillion-parameter model1
.The Taalas deal continues AMD's aggressive expansion of its AI capabilities through acquisitions
2
3
. AMD bought MK1, an AI software startup specializing in high-speed inference, in November2
. The company purchased MEXT in June and added FastFlowLM to its Artificial Intelligence Group in July2
. In 2024, AMD paid $665 million for Silo AI and acquired ZT Systems for $4.9 billion, which provided the technical foundation for its rack-scale products3
5
. AMD reported record revenue of $11.5 billion in its most recent quarter, with its data center segment more than doubling year-over-year to $6.7 billion5
. The company has secured Helios commitments from major customers including Meta, Microsoft, OpenAI, and Anthropic1
5
. AMD stock rose approximately 1.5% following the announcement5
.Summarized by
Navi
[1]
[4]
05 Jun 2025â¢Technology

11 Nov 2025â¢Business and Economy

19 Feb 2026â¢Technology

1
Technology

2
Policy and Regulation

3
Policy and Regulation
