Microsoft Unveils Maia 300 AI Chip in Major Push to Reduce Reliance on Nvidia

Reviewed byNidhi Govil

24 Sources

Share

Microsoft announced its third-generation custom AI chip, Maia 300, designed to become the primary AI inference system across its products. Starting production in 2027, the chip delivers 40% more tokens per megawatt than leading GPU-based systems and seven times the rack-scale throughput of its predecessor. This marks Microsoft's biggest bet yet on self-designed silicon as it aims to reduce dependence on Nvidia.

Microsoft Bets Big on Self-Designed Silicon with Maia 300

Microsoft announced its third-generation custom AI chip, Maia 300, on Monday, marking what CEO Satya Nadella called "our biggest bet yet on our own silicon."

5

The Azure Maia AI accelerator is designed to become the "primary AI inference system for Microsoft products and services," according to Scott Guthrie, executive vice president of Microsoft's cloud group.

1

Production begins in 2027, with multi-gigawatt deployments planned to reduce reliance on Nvidia and AMD chips that currently power most of Microsoft's AI infrastructure.

The move represents a fundamental shift in how Microsoft approaches AI infrastructure. While the company has spent years depending on Nvidia's graphics processing units, it's now positioning Microsoft's homegrown AI chips as the foundation for running AI inference workloads at scale. This vertical integration in AI infrastructure mirrors strategies already deployed by competitors like Google with its Tensor Processing Units and Amazon with its Inferentia and Trainium chips.

4

Massive Efficiency Gains Drive Strategic Pivot

Maia 300 delivers significant performance improvements that translate directly into operational cost savings. The chip produces 40% more tokens per megawatt compared to leading GPU-based systems, according to Microsoft.

3

In a full 96-accelerator rack-scale system configuration, it delivers up to seven times the rack-scale token throughput of Maia 200.

1

Source: GeekWire

Source: GeekWire

These efficiency improvements are critical as power supply has become one of the biggest constraints on AI expansion. Each Maia 300 rack containing 96 chips uses about 167 kilowatts of power, compared with 142 kilowatts used by Nvidia's GB300 AI server racks with 72 GPUs.

3

"It's basically delivering more intelligence for every watt, every dollar, and every byte of memory by optimizing across the entire system," said Rani Borkar, president of Azure hardware systems and infrastructure at Microsoft.

3

Advanced Chiplet Architecture Powers Next-Gen Performance

Microsoft employed a sophisticated chiplet architecture to achieve its efficiency gains. Built on TSMC's N2P process node, the Maia 300 design separates compute, memory controller, and I/O functions into specialized components.

1

The central computing processor uses 2-nanometer technology from Taiwan Semiconductor Manufacturing Co for key computing functions, while other chiplets use cheaper 3-nanometer tech for functions like moving data.

3

Source: Axios

Source: Axios

Each Maia 300 features eight HBM4 memory stacks providing up to 18 TB/s of peak memory bandwidth, optimized for executing large models and long-context workloads.

2

This approach differs from Nvidia's design, which uses one massive computing chip surrounded by high-bandwidth memory chips.

3

Designed for Emerging AI Workloads and Agentic Tasks

Maia 300 is specifically engineered for the new types of AI workloads emerging today: long-context reasoning, latency-sensitive conversational experiences, and sustained, multi-step agentic tasks.

1

Microsoft describes it as "a complete intelligent system" with an inference-first architecture optimized for long-context, memory-intensive and decode-heavy AI workloads.

2

The system-level approach integrates software, silicon, physical rack infrastructure, networking, and datacenters co-designed to operate as a single platform. Microsoft insists this integration is necessary for agentic workloads, which involve multi-step execution, long-context decoding and tool use, fundamentally changing "the computational profile and arithmetic intensity of inference."

2

Maia 200 Already Powering Production Workloads

The current-generation Maia 200, announced in January, is already running production AI inference workloads across Microsoft's ecosystem. It powers Microsoft Copilot, GitHub Copilot, Microsoft Foundry, and Microsoft's own AI models.

1

Guthrie stated that "Maia 200 is the best performing AI infrastructure in our fleet, measured in real world metrics for AI services."

1

The chip is being deployed across the United States, Europe and Australia, with GitHub Copilot and Microsoft Foundry set to move onto it by the end of the year.

5

Nadella told analysts in July that Maia 200 "delivers 30% better performance per dollar than the latest generation hardware in our fleet" and is handling OpenAI models.

4

Strategic Implications for Microsoft's AI Ambitions

Maia 300 plays a critical role in Microsoft's broader AI model development strategy. "We have to work across the full stack, all the way down to the silicon," said Microsoft AI CEO Mustafa Suleyman. "At that scale we need a platform that we own, and that we co-design with our models. That's why running our Microsoft AI models on top of the Maia chip is a critical focus for our team."

1

This vertical integration could help Microsoft improve performance and operational costs while catching up with AI leaders like Google DeepMind, OpenAI, and Anthropic. Finance chief Amy Hood noted at a Goldman Sachs conference that use of its own chips has helped with "margin improvement over the course of a decade."

4

Massive Scale Deployment Plans and Market Impact

Microsoft plans potentially more than a million Maia chips deployed next year to back its internal AI services.

3

The company expects to spend more than $175 billion in capital expenditures this calendar year.

3

Evercore ISI analysts estimate that Maia will represent about 10% of Microsoft's spending on AI chips by the first quarter of 2027.

4

Source: The Register

Source: The Register

However, the transition will be gradual. Alistair Speirs, a general manager at Microsoft, declined to provide a specific timeline, noting "we reserve a little bit of optionality there, because this is an industry that's changing very fast."

4

Microsoft will share more details at its Microsoft Ignite conference next month in San Francisco.

2

Nvidia Partnership Continues Despite Strategic Shift

Despite the push toward self-designed silicon, Microsoft and Nvidia remain significant partners. Nadella and Nvidia CEO Jensen Huang shared the stage last week to launch Windows PCs built on Nvidia chips.

5

Nvidia remains a key supplier for Microsoft's data centers, particularly for training models rather than inference.

4

Nadella said on the company's July earnings call that Microsoft will be among the first cloud providers to deploy next-generation systems based on Nvidia's Vera Rubin and AMD's Helios.

5

When it comes to training models, Microsoft partners with both Nvidia and AMD, according to Speirs.

4

This balanced approach allows Microsoft to maintain flexibility while building greater control over its Azure cloud infrastructure.

Today's Top Stories

© 2026 TheOutpost.AI All rights reserved