Qualcomm Partners with Mistral AI to Bring On-Device Generative AI to Snapdragon Platforms

Qualcomm and Mistral AI Join Forces for On-Device AI

Qualcomm Technologies has announced a groundbreaking partnership with Mistral AI at the Snapdragon Summit 2024. This collaboration aims to integrate Mistral AI's generative AI models, Ministral 3B and Ministral 8B, into devices powered by Qualcomm's Snapdragon platforms 1

1

2

2

.

Targeted Platforms and Benefits

The partnership will optimize Mistral AI's models for various Snapdragon platforms:

• Snapdragon 8 Elite Mobile Platform
• Snapdragon Cockpit Elite and Snapdragon Ride Elite for automotive applications
• Snapdragon X Series Compute Platforms for AI PCs 1

  1

  2

  2

  3

  3

This integration promises several advantages:

1. Enhanced privacy
2. Lower latency
3. Improved reliability
4. Cost savings
5. Greater energy efficiency 1

   1

   3

   3

Ministral 3B and 8B: Compact Yet Powerful

Ministral 3B and 8B are Mistral AI's first commercial AI models designed specifically for on-device use. These compact models offer significant capabilities within the sub-10B parameter range 1

1

2

2

:

• Excel in commonsense reasoning, knowledge, and task orchestration
• Support up to 128k context length
• Ministral 8B features a sliding-window attention pattern for efficient memory use 1

  1

Applications and Performance

The models are adaptable for various applications:

• Agent-based workflows
• Specialized task automation
• On-device translation
• Offline smart assistants
• Local analytics
• Autonomous robotics 1

  1

  3

  3

Mistral AI reports that these models have demonstrated strong performance across various tasks, often surpassing competing models 1

1

.

Integration with Larger Language Models

The Ministral models are effective when used alongside larger language models like Mistral Large. They are optimized for function-calling in complex workflows, managing tasks such as:

• Input parsing
• Task routing
• Executing API calls based on user intent 1

  1

  5

  5

Availability and Developer Access

Qualcomm and Mistral AI are working to make Ministral 3B and 8B available to developers soon via the Qualcomm AI Hub. Currently, developers can access other Mistral AI models, such as Mistral 7B v0.3, through the platform 1

1

2

2

3

3

.

Industry Perspectives

Durga Malladi, Senior Vice President at Qualcomm Technologies, emphasized the collaboration's goal of empowering edge devices with cutting-edge AI technology 1

1

3

3

.

Arthur Mensch, Co-founder and CEO of Mistral AI, highlighted the significance of running their models locally on Snapdragon-powered devices, resulting in faster processing and reduced energy demands 2

2

3

3

.

Implications for the Tech Industry

This partnership represents a significant step towards democratizing access to advanced AI, enabling developers and users worldwide to experience the full potential of these models directly on their devices 2

2

. It also demonstrates the growing trend of bringing AI capabilities closer to end-users, potentially reshaping the landscape of mobile and edge computing 4

4

5

5

.