Qualcomm Partners with Mistral AI to Bring On-Device Generative AI to Snapdragon Platforms

Qualcomm partners Mistral AI to bring On-Device AI models to Snapdragon platforms

Qualcomm Technologies announced its partnership with Mistral AI at the Snapdragon Summit 2024. The collaboration aims to integrate Mistral AI's generative AI models, Ministral 3B and Ministral 8B, into devices powered by Qualcomm's Snapdragon 8 Elite Mobile Platform, Snapdragon Cockpit Elite, Snapdragon Ride Elite for automotive use, and Snapdragon X Series Compute Platforms for AI PCs. Ministral 3B and 8B are Mistral AI's first commercial AI models designed specifically for on-device use. These compact models offer significant power to devices like smartphones, PCs, and vehicles. Running AI on-device delivers several benefits, including improved privacy, reduced latency, cost savings, enhanced reliability, and greater energy efficiency. These models excel in commonsense reasoning, knowledge, and task orchestration within the sub-10B parameter range. They are adaptable for a variety of applications, such as agent-based workflows and specialized task automation. Both models support up to 128k context length, with the Ministral 8B model featuring a sliding-window attention pattern for faster and more efficient memory use during inference. Mistral AI noted increasing demand from clients for local, privacy-first AI models capable of handling tasks like on-device translation, offline smart assistants, local analytics, and autonomous robotics. The Ministral models meet this need by offering efficient, low-latency solutions. These models have demonstrated strong performance across various tasks, often surpassing competing models. The models are also effective when used with larger language models like Mistral Large. They are optimized for function-calling in complex workflows, managing tasks such as input parsing, task routing, and executing API calls based on user intent. This results in extremely low-latency responses and lower operational costs, making them suitable for real-world applications. Qualcomm and Mistral AI are working to make Ministral 3B and 8B available to developers soon via the Qualcomm AI Hub. Developers can already access other Mistral AI models, such as Mistral 7B v0.3, through the platform, empowering them to enhance their on-device AI solutions. Speaking at the event, Durga Malladi, Senior Vice President and General Manager of Technology, Planning, and Edge Solutions at Qualcomm Technologies, Inc., said, We are excited to announce our collaboration with Mistral AI, as it aligns with our goal of empowering edge devices with cutting-edge AI technology. Mistral AI's Ministral 3B and Ministral 8B will enable device manufacturers, software vendors, and service providers to create innovative experiences, such as AI assistants and other applications that truly understand users' needs, all while offering the immediacy, reliability, and enhanced privacy of on-device AI. Speaking about the collaboration, Arthur Mensch, Co-founder and CEO of Mistral AI, said,

Qualcomm and Mistral AI Partner to Bring New Generative AI Models to Edge Devices

Qualcomm announces collaboration with Mistral AI to bring Mistral AI's models to devices powered by Snapdragon and Qualcomm platforms.Mistral AI's new state-of-the-art models, Ministral 3B and Ministral 8B, are being optimized to run on devices powered by the new Snapdragon 8 Elite Mobile Platform, Snapdragon Cockpit Elite and Snapdragon Ride Elite, and Snapdragon X Elite Compute Platform.Mistral 7B v0.3 is currently available on the Qualcomm AI Hub and Ministral 3B and Ministral 8B will be coming soon. At Snapdragon Summit, Qualcomm Technologies, Inc. today announced its collaboration with Mistral AI to bring Mistral AI's new state-of-the-art generative AI models, Ministral 3B and Ministral 8B, to devices powered by the Snapdragon® 8 Elite Mobile Platform, Snapdragon® Cockpit Elite and Snapdragon Ride™ Elite for automotive applications, and Snapdragon® X Series Compute Platforms for AI PCs. Ministral 3B and Ministral 8B are Mistral AI's first premier, commercial AI model designed specifically for on-device use. Mistral AI's Ministral 3B and Ministral 8B are compact yet powerful, making them ideal for running within devices such as smartphones, vehicles, PC's, and more. Running generative AI on devices offers numerous benefits, including enhanced privacy, lower latency, reliability, cost savings, and energy efficiency. "We are thrilled to announce our collaboration with Mistral AI to help achieve our goal of empowering devices at the edge with the latest advancements in AI technology," said Durga Malladi, senior vice president and general manager of technology, planning and edge solutions, Qualcomm Technologies, Inc. "Mistral AI's Ministral 3B and Ministral 8B will enable device manufacturers, software vendors, and digital service providers to deliver innovative experiences, such as AI assistants and other applications that understand users' wants and needs, thanks to the immediacy, reliability, and enhanced privacy of on-device AI." "This collaboration with Qualcomm Technologies is a significant milestone for Mistral AI, demonstrating the ability of our new models to run locally on devices powered by Snapdragon platforms, resulting in faster local processing that can help reduce cost and energy demands," said Arthur Mensch, co-founder and CEO of Mistral AI. "Together, we are democratizing access to advanced AI, empowering developers and users worldwide to experience the full potential of our models right on their devices." The parties are collaborating to bring Ministral 3B and Ministral 8B to developers soon via the Qualcomm® AI Hub. Developers can currently access other popular Mistral AI models on the Qualcomm AI Hub, including Mistral 7B v0.3, empowering developers and users to leverage Mistral AI's advanced capabilities. To learn more about Mistral AI, visit www.mistral.ai. Additional information, livestream replays and event content are also available on the Snapdragon Summit Event Hub [link].

Qualcomm and Mistral AI Partner to Bring Generative AI to Snapdragon Devices

On-device AI ensures enhanced privacy, lower latency, and energy efficiency. Qualcomm Technologies announced its partnership with Mistral AI to integrate the AI company's new generative models, Mistral 3B and 8B, into Snapdragon-powered devices. Mistral AI's new on-device models, Mistral 3B and Mistral 8B, are being optimised to run on devices powered by the new Snapdragon 8 Elite Mobile Platform, Snapdragon Cockpit Elite, Snapdragon Ride Elite for automotive applications, and Snapdragon X Series Compute Platform for AI PCs. Also Read: Mistral AI Unveils New Models for On-Device AI Computing Qualcomm noted that Ministral 3B and Ministral 8B are Mistral AI's first commercial AI models designed specifically for on-device use. These compact yet powerful AI models are designed for on-device use in smartphones, vehicles, and PCs, offering benefits such as enhanced privacy, lower latency, and energy efficiency, the official release said. "We are thrilled to announce our collaboration with Mistral AI to help achieve our goal of empowering devices at the edge with the latest advancements in AI technology," said Durga Malladi, senior vice president and general manager of technology, planning and edge solutions, Qualcomm Technologies. "Mistral AI's Ministral 3B and Ministral 8B will enable device manufacturers, software vendors, and digital service providers to deliver innovative experiences, such as AI assistants and other applications that understand users' wants and needs, thanks to the immediacy, reliability, and enhanced privacy of on-device AI." "This collaboration with Qualcomm Technologies is a significant milestone for Mistral AI, demonstrating the ability of our new models to run locally on devices powered by Snapdragon platforms, resulting in faster local processing that can help reduce cost and energy demands," said Arthur Mensch, co-founder and CEO of Mistral AI. "Together, we are democratising access to advanced AI, empowering developers and users worldwide to experience the full potential of our models right on their devices." Also Read: SAP Expands Its Partnership with Mistral AI to Broaden Customer Choice Qualcomm and Ministral are collaborating to bring Ministral 3B and Ministral 8B to developers soon via the Qualcomm AI Hub. Developers can currently access other Mistral AI models on the Qualcomm AI Hub, including Mistral 7B v0.3, enabling developers and users to leverage Mistral AI's capabilities.

Qualcomm Doubles Down on AI with Mistral AI Collaboration - Phandroid

Qualcomm recently announced that it's partnered with Mistral AI to integrate the latter's genAI software to device running on Qualcomm's new Snapdragon 8 Gen 3 chipset, Snapdragon X Compute, as well as its new Snapdragon Cockpit Elite and Ride Elite automotive platforms. More specifically, the collaboration will bring Mistral AI's Ministral 3B and Ministral 8B AI models for on-device usage. Due to their relatively compact sizes, the 3B and 8B are ideal for use with hardware including vehicular infotainment systems, smartphones, and even computers. They're also power-efficient, and feature enhanced privacy capabilities. Durga Malladi, Senior VP GM for technology, planning and edge solutions at Qualcomm states: We are thrilled to announce our collaboration with Mistral AI to help achieve our goal of empowering devices at the edge with the latest advancements in AI technology... Mistral AI's Ministral 3B and Ministral 8B will enable device manufacturers, software vendors, and digital service providers to deliver innovative experiences, such as AI assistants and other applications that understand users' wants and needs, thanks to the immediacy, reliability, and enhanced privacy of on-device AI. READ: Qualcomm and Google Want to Make Your Next Car More Futuristic With all that said, we can expect Ministral 3B and 8B to arrive for developers soon via Qualcomm's AI hub, which already features access to other Mistral AI models including 7B vo.3.

Snapdragon Chipsets Will Be Optimised for Mistral's On-Device AI Models

On-device AI capability will also reduce latency in processing AI tasks Qualcomm announced a partnership with artificial intelligence (AI) firm Mistral on Wednesday. Announced at the Snapdragon Summit, this partnership will see Mistral's two AI models -- Ministral 3B and Ministral 8B -- be optimised to run on-device on devices powered by various Snapdragon Elite series chipsets. The company said that these AI models will add AI capabilities to smartphones, PCs, vehicles, and more. The move is aimed at improving processing speeds and reducing the power consumption of AI tasks. In a press release, the chip maker formally announced that Qualcomm and Mistral will be working together to introduce specific AI models designed to run on-device. The move is aimed at reducing the reliance on edge and cloud processing of AI tasks, which is considered both energy-intensive and slower compared to local processing. Qualcomm also added that these AI models will be optimised for not only its Mobile Platforms but also for PCs and the vehicle ecosystem. With this partnership, Ministral 3B and Ministral 8B will be optimised to run on devices powered by the recently launched Snapdragon 8 Elite for smartphones, Snapdragon Cockpit Elite and Snapdragon Ride Elite for automotives, and Snapdragon X Elite for AI PCs. The Ministral 3B and 8B AI models were launched last week. They are the company's first large language models (LLMs) designed for commercial usage. These models support function-calling making them ideal for application programming interface (API) use cases. As per Mistral, the AI models support up to 1,28,000 token context length. Qualcomm stated that on-device AI models will offer multiple benefits to end users including improved privacy, lower latency, higher reliability, energy efficiency, and cost savings. "Mistral AI's Ministral 3B and Ministral 8B will enable device manufacturers, software vendors, and digital service providers to deliver innovative experiences, such as AI assistants and other applications that understand users' wants and need," said Durga Malladi, Senior Vice President and General Manager of Technology, Planning and Edge Solutions at Qualcomm Technologies. Currently, developers can access the Mistral 7B v0.3 AI model via the Qualcomm AI Hub. The two Ministral AI models will be added to the hub in coming weeks.