Amazon plans to sell Trainium AI chips directly, mounting a $50 billion challenge to Nvidia

Amazon hopes to challenge Nvidia more directly by selling its AI chips

If Amazon Web Services has its way, the cloud giant is going to push even deeper into Nvidia's market, in what might be one of the biggest challenges to Nvidia's AI chip dominance we've seen so far. Amazon's AI chief Peter DeSantis told Bloomberg that AWS is in talks to sell its AI chip Trainium to other companies for use in data centers. DeSantis declined to specify which companies could be the buyers of such chips. Such talks about selling chips are in the early stages, the company tells TechCrunch, and stem from Amazon CEO Andy Jassy's annual shareholder letter in early April, in which he said the company's homegrown AI chips were so coveted that he was thinking about selling them. "If our chips business was a standalone business, and sold chips produced this year to AWS and other third parties (as other leading chips companies do), our annual run rate would be ~$50 billion. There's so much demand for our chips that it's quite possible we'll sell racks of them to third parties in the future." How much of a challenge to Nvidia could Amazon be? A $50 billion competitor wouldn't exactly tank Nvidia -- which is currently on a $326 billion revenue run rate -- if it keeps delivering quarters like the last one. But it's akin to Intel's annual revenues. AWS has so far resisted selling its AI chips for a lot of reasons. The biggest is that the money AWS actually makes on its chips is a waterfall effect. Sure, it charges customers directly for the AI tokens those chips process on its cloud, but it also gets to charge for a host of other services companies need for their AI apps, including storage, security, networking, and monitoring services. Equally importantly, Amazon has touted the capacity of its chips has been selling out faster than it can produce them. In that same shareholder letter in April, Jassy said the current Trainium chip capacity had sold out almost instantly. So too, he said, had the capacity for the next one, Trainium4, which won't even be available for more than a year. This was before AWS formally added OpenAI to the models it was serving up. So selling its chips to others means it would likely have to leave current customers on waiting lists, unless it could somehow manufacture a surplus of chips through its manufacturing partners such as TSMC. But it would have to miraculously elbow Nvidia out of the way to do that with TSMC, which has recently supplanted Apple to become the foundry's largest customer. AWS spokesperson Doron Aronson (who hosted me during a recent private tour of the AWS chip design facility) also confirmed that AWS may sell these chips. "While we've historically declined requests to sell chips directly, Andy noted it's quite possible we'll sell racks of them to third parties in the future." So while Nvidia's founder and CEO Jensen Huang recently declared that he's found a brand new $200 billion market for Nvidia in selling CPUs for AI, not just GPUs -- thereby moving into Intel and AMD territory -- Jassy clearly has his own chip ambitions: a $50 billion market that would put elbow more directly into Nvidia's world.

Amazon in talks to sell custom AI chips in bid to cut Nvidia's dominance

Amazon is planning to sell its custom artificial intelligence chips to other companies. This move aims to compete with Nvidia's strong hold in the market. Amazon's AI chief confirmed discussions are underway. The company sees a growing demand for AI infrastructure globally. This expansion could significantly impact the AI chip industry. Amazon is in talks to sell its custom-made artificial intelligence chips for use in other companies' data centers, a key expansion of its efforts to cut into Nvidia Corp.'s dominance. Peter DeSantis, Amazon's AI chief, said the world's largest cloud computing company has begun discussions but declined to name potential customers. "We view AI infrastructure as rapidly evolving," he said in an interview in Paris. "And we're constantly looking at ways to get to more customers." Amazon shares gained as much as 1.8% on Thursday, reaching an intraday high of $241.82 on the news. Introduced in 2020, Amazon's AI accelerator, Trainium, has won a few marquee buyers, including OpenAI, Anthropic PBC and Uber Technologies Inc., which access the hardware via Amazon Web Services. The chip has produced more than $225 billion in revenue commitments, Amazon said in April. That same month, Chief Executive Officer Andy Jassy wrote in his shareholder letter that it's "quite possible" Amazon would sell racks of its chips to third parties. It was part of a broader attempt to reposition the sprawling company around AI, an area where it's seen as falling behind rivals. Amazon and other cloud computing titans have each been developing their own alternatives to Nvidia's popular graphics processing units -- and ramped up these efforts after ChatGPT's arrival. While the AI boom has generated soaring cloud sales, it's also fueled a new crop of specialized AI cloud providers and driven demand for "sovereign" services in Europe and other regions that are subject to local laws and usually locate information and data processing in the host country. In April, Alphabet Inc. CEO Sundar Pichai said Google will begin to deliver its Nvidia GPU rival chips, called tensor processing units, to a "select group of customers" for use in their own data centers. Amazon is following suit with Trainium, in part, due to the growing demand outside of the US for computing resources that are controlled locally, according to DeSantis. Some of that push, particularly in Europe, has prompted calls for countries to lessen their reliance on US technology or drop it altogether. Speaking at the VivaTech conference in France, DeSantis said the AWS business has not been impacted at all by this trend. The third version of the Trainium chip, which began shipping earlier this year, is "largely sold out," he said. Amazon said there's already strong interest in a fourth version that's expected to debut next year. DeSantis dismissed the idea that selling Trainium outside of AWS would eat into the company's cloud business. "There's so much underconsumption in AI," he said. "I'm not worried about it." The executive also cited growth for Amazon's Graviton chips, a general-purpose processor that it recently began providing to Meta Platforms Inc. Over the last three years, DeSantis said Amazon has added more Graviton chips to its computing systems than any other type of chip.

Inside the lab where Amazon is taking on Nvidia: Jon Erlichman

In an industrial park in Austin, Texas, behind glass doors that look like any other corporate office, Amazon is building one of the most important businesses in technology. Some investors haven't noticed yet. But they will soon. We spent a day inside Annapurna Labs, where Amazon designs incredibly powerful and cost effective chips for its Amazon Web Services customers. Not only are Amazon's efforts helping to democratize AI, the company is quickly becoming a credible rival to longtime partner Nvidia. Its custom chip business is now running at more than US$20 billion a year, growing at triple-digit rates. That's bigger than many of the most-watched names in tech, hiding in plain sight inside a company most investors still think of as a retail and cloud business. Amazon CEO Andy Jassy summed it up in his most recent shareholder letter: "Our chips business is on fire." The acquisition nobody noticed In 2015, Amazon paid a reported US$350 million for a small Israeli chip design firm called Annapurna Labs. The deal barely made the news. At the time, almost nobody asked why Amazon, a company not generally known for making hardware, was suddenly buying a chip business. The answer, more than a decade later, is clear. And some now view the acquisition as one of the smartest deals Amazon ever made. Annapurna's engineers, working alongside teams in Austin and other Amazon design centres, have built three families of custom chips that now sit at the heart of Amazon Web Services. Graviton, a general-purpose processor that competes with Intel and AMD. Nitro, the chip that runs the internal plumbing of the AWS cloud. And Trainium, the family of AI chips designed to train and run the largest models in the world. Trainium is the one drawing the comparisons to Nvidia. Inside the lab Walking through the Annapurna space in Austin, the first thing that strikes you is how unassuming it is. There are no sparks, no smoke, no clean rooms. The actual fabrication of these chips happens elsewhere, at TSMC's plants in Taiwan. What happens in Austin is design. That means engineers at workstations. Whiteboards covered in diagrams. Test rigs, where prototype chips are pushed through their first runs before they're sent off to be manufactured at scale. During our tour, my Ticker Take co-host Caroline Lesley asked Kris King, Senior Software Development Manager and Director of the Austin Annapurna Labs, about a set of small dots she had noticed on one of the chips. They turned out to be voltage probes: tiny test points engineers use to verify that current is flowing through the chip exactly the way it was designed to. The detail was, on its face, mundane. But it captures something important about the work. It is painstaking, deeply specialized, and almost invisible to the outside world. Ron Diamant, the chief architect of Trainium and the person most responsible for the way these chips are designed, relished the question. This is a team that has eagerly and excitedly committed itself to delivering the most common ask among AWS customers: offer powerful chips that are equally cost effective. At another point, King held up a Trainium3 chip next to its predecessor. To the eye, the two look almost identical. But the silicon technology inside shrank from 5 nanometers to 3 nanometers, allowing Amazon's engineers to pack significantly more logic and functionality into the same footprint. The result was a 4.4 times jump in performance, generation over generation. Why it matters The reason Amazon got into the chip business in the first place is simple economics. AWS, Amazon's cloud business, was buying enormous quantities of chips from outside vendors. The more Amazon could design and produce its own, the lower its costs would be, and the more efficient its cloud could become. For a long time, that was largely a story about cost. Graviton and Nitro made AWS faster and cheaper to run. The savings showed up in margins. Trainium changes the story Trainium is an AI chip. It is designed specifically to train and run the large language models that have come to define the current technology cycle. And it is being adopted by some of the most important names in artificial intelligence. Anthropic, the maker of the Claude AI assistant, runs Claude on more than a million of Amazon's Trainium2 chips. The two companies are partners in a project called Rainier, a massive new compute cluster built specifically for AI training. OpenAI, long synonymous with Microsoft's cloud, has signed on for two gigawatts of Trainium capacity. Apple uses some of Amazon's chips too, though it runs its own consumer AI on chips it designs itself. The performance numbers help explain why. Trainium3, Amazon's newest generation of AI chip, can deliver up to four times the performance of the previous version. And Amazon doesn't sell these chips. It rents them, by the hour, through AWS. That keeps customers inside the AWS ecosystem and produces recurring revenue, not a one-time hardware sale. The Nvidia question The temptation, looking at all of this, is to ask whether Amazon is in a position to potentially dethrone the leading AI chip player, Nvidia. After all, its commitment to innovation and customer satisfaction has already made it one of the world's most valuable companies. The honest answer, though, is no. Ron Diamant, the chief architect of Trainium and a Vice President and Distinguished Engineer at AWS, put it plainly when we sat down with him in Austin. "We're not trying to replace Nvidia," he said. "Here at Amazon, we see ourselves as the everything store. So we'll offer Nvidia, and we'll offer Trainium, for many years to come. The Nvidia partnership has been great. They build fantastic chips." Nvidia still dominates the AI chip market. Its CUDA software platform has become the default for AI development worldwide. Most of the companies using Trainium also buy plenty of Nvidia chips, and will keep doing so for years. The collaboration runs both ways. Nvidia itself recently invested US$10 billion in Anthropic, Amazon's own AI partner. What Amazon is doing is different. By offering its own chips alongside Nvidia's, AWS gives customers more choice, better pricing flexibility, and an alternative they can lean on if Nvidia supply gets tight or expensive. For Amazon itself, owning the chip means owning more of the margin. It's not winner-take-all. It's a race to control cost. What it means for investors The spending we've seen by tech giants during the AI boom is unprecedented. And in some cases, nerve-racking to investors. In the case of Amazon, it plans to lay out roughly US$200 billion in capital expenditures this year, much of it on the data centres and chip capacity needed to run all of the above. But Amazon remains one of the most beloved stocks on Wall Street. And that big spending could have a big payoff. Consider margins. The more chips Amazon designs in-house, the less it has to buy from outside vendors. Jassy, in his 2025 shareholder letter, said Trainium could save the company tens of billions of dollars in capital spending a year. There's the customer satisfaction angle. Amazon is aggressively rolling out AI chips to give its long list of AWS clients -- including Meta, Uber, Stripe, Snap Inc, Pinterest and Lyft -- more cost effective options to keep their own AI spending bills down. And it's worth highlighting Anthropic. Amazon has invested about US$8 billion in the AI company, in a series of deals stretching back several years. That stake is now estimated to be worth roughly US$74 billion. Anthropic recently filed to go public. If the IPO performs anything like SpaceX's did, it could be one of the largest tech listings in years. Over the past two decades, Amazon stock has returned roughly 15,000 per cent, placing it among the top five performers in the Nasdaq 100. The chip business could help to keep that streak of outperformance going. There is one more variable worth watching. Today, Amazon makes money from these chips by renting them out to its AWS customers. The revenue flows through the cloud business. But Jassy himself has floated what the chip business could look like if it ever stood on its own: a roughly US$50 billion enterprise, hypothetically, if Amazon were to sell chips to outside customers. When we asked Ron Diamant whether Amazon could one day go that direction, his answer was open-ended. "We're constantly having these discussions," he said. "At the end of the day, what we want to do is provide maximum customer value, and there's more than one way to do that. We can rent these chips hourly, yearly, or on a multiyear contract through AWS, or we can deliver servers to our customers. We're looking into it. We don't have anything to announce just yet, but we'll do whatever it takes to provide the most value to our customers." Back in the lab Standing in front of a rack of Trainium servers in Austin, it's easy to forget the scale of what these chips are powering. They look like ordinary computer components. Black boxes, fans, cables. But the same chips designed in that quiet lab are training Claude. They are running a piece of OpenAI's infrastructure. They are powering, in one form or another, a large fraction of the AI tools becoming part of daily life. Amazon is not a chipmaker in the traditional sense. It does not run fabrication plants. It does not sell chips to consumers. It does not put its name on the front of a server box. But quietly, deliberately, and with the kind of patience that has long defined the company, it has built a chip business large enough to change the conversation. And in the AI era, that might turn out to be the most valuable thing it does. Jon Erlichman is a BNN Bloomberg contributor and the host of Ticker Take on YouTube.