Intel Shifts AI Strategy: Focuses on Cost-Effective Solutions with Gaudi 3 Chips

Intel's Strategic Shift in AI Market

Intel, once a dominant force in the semiconductor industry, is pivoting its artificial intelligence (AI) strategy in response to Nvidia's overwhelming success in the high-end AI chip market. The company is now positioning its Gaudi 3 accelerator chips as a cost-effective solution for businesses seeking economical AI systems, particularly for inferencing and smaller, task-based models 1

1

2

Gaudi 3: Performance and Positioning

Intel claims that Gaudi 3 offers competitive performance against Nvidia's H100 GPU, especially in inferencing tasks:

• 9% faster than H100 for 8-billion-parameter Llama 3 model, with 80% better performance-per-dollar 1

  1

• 19% faster than H100 for 70-billion-parameter Llama 2 model, with 2x better performance-per-dollar 1

  1

• Comparable power efficiency to H100 for large language model (LLM) inferencing 1

  1

However, Gaudi 3 falls short in overall floating-point operations throughput compared to the H100, particularly in 8-bit precision calculations 1

1

Market Strategy and Partnerships

Intel is targeting businesses that need cost-effective AI systems for training and inferencing smaller, task-based models and open-source models. The company has secured partnerships with:

• Dell Technologies and Supermicro (servers available in October) 1

  1

• Hewlett Packard Enterprise (system expected in December) 1

  1

• IBM Cloud (services available early next year) 1

  1

• Intel Tiber AI Cloud (Intel's rebranded cloud service) 1

  1

Competitive Landscape

Intel faces stiff competition in the AI chip market:

• Nvidia continues to dominate with its H100 and H200 GPUs, and plans to release next-generation Blackwell GPUs by year-end 1

  1

• AMD is gaining ground with its Instinct MI325X GPU, claiming superior inference performance over Nvidia's H200 1

  1

Intel's Rationale

Anil Nanduri, head of Intel's AI acceleration office, explained the company's strategy:

1. Acknowledging the incumbent advantage of Nvidia in high-end AI training 1

   1

2. Recognizing that many businesses cannot afford massive investments in cutting-edge AI infrastructure 1

   1

3. Betting on the increasing adoption of smaller, more focused LLM models in the future 2

   2

Related Stories

Intel's AI Chip Strategy Faces Challenges Amid Competitive Landscape

Intel Challenges AI Cloud Market with Gaudi 3-Powered Tiber AI Cloud and Inflection AI Partnership

Intel Faces Setbacks in AI and Server CPU Markets Amid Leadership Changes

Intel Crescent Island targets AI inference with cheaper memory, air-cooling to challenge Nvidia

Industry Implications

Intel's shift highlights a potential bifurcation in the AI chip market:

1. High-end segment dominated by Nvidia, focused on training massive AI models
2. Cost-effective segment targeted by Intel, catering to businesses with more modest AI computing needs

This strategy could open up new opportunities for Intel in the AI space, particularly as companies begin to question the return on investment of large-scale AI infrastructure 2

2

Conclusion

As the AI chip market continues to evolve, Intel's repositioning with Gaudi 3 represents a significant shift in the competitive landscape. While the company may not challenge Nvidia's dominance in high-end AI training, its focus on cost-effective solutions could carve out a valuable niche in the rapidly expanding AI market.