Microsoft Maia 300: Third-Generation AI Chip Aims to Cut Nvidia Dependence by 2027

12 Sources

Share

Microsoft announced its third-generation in-house AI chip, Maia 300, designed to become the primary AI inference system across its products starting in 2027. The custom AI chip delivers 40% more tokens per megawatt than leading GPU-based systems and up to 7x the rack-scale throughput of its predecessor, marking the company's biggest bet yet on self-designed silicon to reduce reliance on Nvidia.

Microsoft Unveils Maia 300 as Primary AI Inference System

Microsoft announced Maia 300, its third-generation in-house AI chip, positioning it to become the primary AI inference system for Microsoft products and services starting in 2027

1

. CEO Satya Nadella called this move "our biggest bet yet on our own silicon," signaling a strategic shift to reduce reliance on Nvidia's GPUs

4

. The custom AI chip is designed specifically for AI workloads including long-context reasoning, latency-sensitive conversational experiences, and sustained multi-step agentic tasks that are rapidly emerging in the AI landscape

1

.

Source: The Next Web

Source: The Next Web

Efficiency Gains Drive Vertical Integration Strategy

The Maia 300 delivers substantial efficiency improvements through innovative chiplet architecture built on TSMC's N2P process node

1

. Microsoft expects the chip to produce 40% more tokens per megawatt compared to leading GPU-based systems, translating directly into operational cost savings for data center operations

3

. In a full 96-accelerator configuration, each data center rack delivers up to 7x the rack-scale token throughput of Maia 200, its predecessor

1

. These racks consume approximately 167 kilowatts of power, compared to Nvidia's GB300 AI server racks with 72 GPUs that draw about 142 kilowatts

2

.

Multi-Gigawatt Deployments Signal Massive Scale

Microsoft plans multi-gigawatt deployments of its homegrown AI chips starting in 2027, potentially representing more than a million Maia 300 chips

2

5

. Scott Guthrie, executive vice president of Microsoft's cloud group, stated that "we will scale our Azure Maia family to multi-gigawatt deployments starting in 2027, making Maia the primary AI inference system for Microsoft products and services"

1

. This deployment scale comes as Microsoft expects to spend more than $175 billion in capital expenditures this calendar year

2

. Evercore ISI analysts estimate that Maia will represent approximately 10% of Microsoft's spending on AI chips by the first quarter of 2027

3

.

Source: The Verge

Source: The Verge

Chiplet Architecture Enables Performance Breakthrough

The proprietary AI chips leverage a new chiplet architecture that separates compute, memory controller, and I/O functions across different process nodes

1

. The central computing processor uses specialized chiplets bonded together, with 2-nanometer technology from TSMC for key computing functions and cheaper 3-nanometer tech for data movement and other functions

2

. "This increases the silicon area dedicated to compute performance and allows each function to use the technology best suited to its role," according to Microsoft's Azure hardware and infrastructure team

1

. Each chip carries eight stacks of HBM4 memory, optimizing performance across the entire system

5

.

Current Maia 200 Already Powers Microsoft Services

Maia 200, announced in January, is already running production AI workloads across Microsoft's ecosystem, including Microsoft Copilot, GitHub Copilot, Microsoft Foundry, and Microsoft's own AI models

1

. Guthrie noted that "Maia 200 is the best performing AI infrastructure in our fleet, measured in real world metrics for AI services"

1

. The chip also runs OpenAI models delivered on Microsoft's Azure cloud computing service

2

. CEO Satya Nadella stated in July that Maia 200 "delivers 30% better performance per dollar than the latest generation hardware in our fleet"

3

.

Strategic Implications for Microsoft's AI Ambitions

The self-designed silicon strategy is critical for Microsoft's goal of competing with Google DeepMind, OpenAI, and Anthropic in AI model development. Microsoft AI CEO Mustafa Suleyman emphasized: "We have to work across the full stack, all the way down to the silicon. At that scale we need a platform that we own, and that we co-design with our models. That's why running our Microsoft AI models on top of the Maia chip is a critical focus for our team"

1

. Rani Borkar, president of Azure hardware systems and infrastructure, explained that the chip is "basically delivering more intelligence for every watt, every dollar, and every byte of memory by optimizing across the entire system"

2

.

Source: ET

Source: ET

Industry Context and Competitive Landscape

Microsoft's move reflects a broader industry trend as tech giants design their own AI chips to loosen Nvidia's grip on the AI computing market

2

. Google has started selling its Tensor Processing Units directly to customers, Amazon has won over companies like Anthropic with its Trainium chips, Meta has rolled out its own AI chips, and OpenAI unveiled its first custom chip built with Broadcom in June

4

. However, Microsoft and Nvidia remain significant partners—Nadella and Nvidia CEO Jensen Huang shared the stage last week to launch Windows PCs built on Nvidia chips, and Nvidia continues as a key supplier for Microsoft's data centers, particularly for training models

3

4

. Microsoft plans to share more details about Maia 300 at its Ignite conference in San Francisco next month

4

5

.

Today's Top Stories

© 2026 TheOutpost.AI All rights reserved