AMD's AI GPU Business Surges, Rivaling Its CPU Operations in Less Than a Year

AMD's AI GPU Business Experiences Rapid Growth

AMD's AI GPU business, primarily driven by the Instinct MI300 series, has experienced explosive growth in less than a year since its introduction. CEO Lisa Su revealed during a recent earnings call that the company's AI GPU revenue is now approaching the scale of its entire CPU business, which includes servers, cloud computing, desktop PCs, and laptops 1

1

2

2

.

Financial Performance and Market Position

The company's data center GPU business has exceeded initial expectations, with revenues for September 2023 alone surpassing $1.5 billion 1

1

. This rapid growth has contributed to AMD's share price increasing by approximately 2.5 times since mid-2022 1

1

. However, while impressive, AMD's AI GPU sales still trail behind industry leader Nvidia, which is projected to achieve $50 to $60 billion in AI GPU sales by 2025 1

1

2

2

.

Instinct MI300 Series Specifications

The Instinct MI300 series, AMD's first truly competitive GPU for AI inferencing and training, offers significant improvements in memory capacity and bandwidth:

• MI300X GPU: 304 GPU compute units, 192 GB of HBM3 memory, 5.3 TB/s peak theoretical memory bandwidth
• MI300A APU: Integrates 24 Zen 4 x86 CPU cores with 228 GPU compute units, 128 GB of Unified HBM3 Memory 2

  2

Market Adoption and Partnerships

AMD is working on over 100 customer engagements for the MI300 series, including major tech companies like Microsoft, Meta, and Oracle 2

2

. Microsoft has recently announced the general availability of its ND MI300X VM series, featuring eight AMD MI300X Instinct accelerators 2

2

.

Future Market Projections

Lisa Su predicts significant growth in the AI GPU market:

• The AI accelerator TAM (Total Addressable Market) is expected to grow at more than 60% annually, reaching $500 billion by 2028 3

  3

• This projected market size is comparable to the entire semiconductor industry's annual sales in 2023 3

  3

Competitive Landscape and Strategy

AMD is positioning itself as a challenger to Nvidia in the AI GPU market:

• The company is accelerating its product development pace, aiming for an annual cadence of new Instinct products 4

  4

• The next-gen MI350-series is on track to launch in the second half of 2025, promising the largest generational increase in AI performance 4

  4

• AMD is also focusing on software advancements with the ROCm stack, offering an "open alternative" to Nvidia's closed software ecosystem 4

  4

Challenges and Future Outlook

While AMD's growth in the AI GPU market is impressive, the company faces challenges:

• Capturing market share from entrenched competitors in the data center GPU segment requires time and patience 4

  4

• AMD acknowledges potential "lumpiness" in growth due to the nature of large customer acquisitions and deployments 4

  4

• The company is preparing to ramp up production and optimize for larger deployments, but cautions about an uncertain future 4

  4

As AMD continues to invest in AI hardware and software development, it aims to establish itself as a strong competitor in the rapidly growing AI accelerator market, while maintaining its commitment to other sectors such as gaming and personal computing.