Apple Embraces Amazon's AI Chips for Intelligence Model Training and Search Efficiency
13 Sources
[1]
Apple Intelligence Models Will Now Reportedly Be Trained Using Amazon's Custom Chips, Allowing For A 40 Percent Improvement In Search Efficiency
Amazon Web Services chips will reportedly be used to train Apple Intelligence models, which is not something out of the ordinary because technology giants are known for sourcing such hardware. Of course, it will be the Cupertino firm's responsibility to ensure that its services will be used with a
[2]
Apple Intelligence is Nothing without AWS
Apple is also exploring AWS's Trainium2 chips, with early evaluations suggesting a 50% improvement in pre-training efficiency. Apple surprised everyone with its presence at AWS re:Invent 2024. During his keynote, AWS chief Matt Garman invited Benoit Dupin, Apple's senior director of machine
[3]
Apple says it uses Amazon's custom AI chips
Amazon CEO, Andy Jassy speaking with CNBC's Jim Cramer on Mad Money in Seattle, WA. on Dec. 6th, 2023. Apple is currently using Amazon Web Services' custom artificial intelligence chips for services like search and will evaluate if the company's latest AI chip can be used to pre-train its models
[4]
Apple turns to Amazon chips for AI pre-training and more - 9to5Mac
As reported by CNBC, Apple's senior director of machine learning and artificial intelligence, Benoit Dupin, made a surprise appearance at Amazon's AWS re:Invent conference in Las Vegas today. Dupin used the opportunity to explain that Apple uses custom artificial intelligence chips from Amazon Web
[5]
Apple considers using Amazon chips to train future Apple Intelligence models
Apple Intelligence features may get trained with Amazon AI chips Apple is using chips sourced from Amazon Web Services to handle searches, and it may also use them to pre-train Apple Intelligence AI models. It is common knowledge that large companies like Apple rely on external service providers
[6]
Apple Uses Amazon's Custom AI Chips for Search Services
Apple uses custom Trainium and Graviton artificial intelligence chips from Amazon Web Services for search services, Apple machine learning and AI director Benoit Dupin said today at the AWS re:Invent conference (via CNBC). Dupin said that Amazon's AI chips are "reliable, definite, and able to
[7]
Amazon's cloud service shows new AI servers, says Apple will use its chips
LAS VEGAS (Reuters) - Amazon.com's cloud unit on Tuesday showed new data center servers packed with its own AI chips that will challenge Nvidia, with Apple coming aboard as a customer to use them. The new servers, based on 64 of Amazon Web Services' Trainium2 chips, will be strung together in a
[8]
Amazon's cloud service shows new AI servers, says Apple will use its chips
LAS VEGAS, Dec 3 (Reuters) - Amazon.com's (AMZN.O), opens new tab cloud unit on Tuesday showed new data center servers packed with its own AI chips that will challenge Nvidia (NVDA.O), opens new tab, with Apple coming aboard as a customer to use them. The new servers, based on 64 of Amazon Web
[9]
Amazon launches new AI servers, Apple joins as customer By Investing.com
Amazon (NASDAQ:AMZN) Web Services (AWS) has announced the introduction of new data center servers equipped with its proprietary artificial intelligence (AI) chips, presenting a challenge to Nvidia (NASDAQ:NVDA)'s dominance in the sector. Apple Inc (NASDAQ:AAPL). has been confirmed as a customer,
[10]
Amazon's AWS unveils new supercomputer with its AI chips in a challenge to Nvidia
Amazon.com's cloud unit on Tuesday showed new data center servers packed with its own AI chips that will challenge Nvidia, with Apple coming aboard as a customer to use them. The new servers, based on 64 of Amazon Web Services' Trainium2 chips, will be strung together in a massive supercomputer
[11]
Amazon's cloud service shows new AI servers, says Apple will use its chips
The new servers, which AWS calls Trn2 UltraServers, will compete against Nvidia's flagship server packing 72 of its latest "Blackwell" chips. Both companies also offer proprietary technology for connecting the chips, though Gadi Hutt, who leads business development for the AI chips at AWS, said
[12]
Nvidia Rules A.I. Chips, but Amazon and AMD Emerge as Contenders
On the south side of Austin, Texas, engineers at the semiconductor maker Advanced Micro Devices designed an artificial intelligence chip called MI300 that was released a year ago and is expected to generate more than $5 billion in sales in its first year of release. Not far away in a north Austin
[13]
The furious contest to unseat Nvidia as king of AI chips
Nvidia's rivals have also started taking a leaf out of the company's playbook in another way. They have begun emulating Nvidia's tactic of building complete computers -- and not just the chips -- so that customers can wring the maximum power and performance out of the chips for AI purposes.On the
Share
Copy Link
Apple reveals its use of Amazon Web Services' custom AI chips for services like search and considers using Trainium2 for pre-training AI models, potentially improving efficiency by up to 50%.
Apple's Surprising Collaboration with Amazon Web Services
In a surprising revelation at Amazon's annual AWS re:Invent conference, Apple disclosed its use of Amazon Web Services' (AWS) custom artificial intelligence chips for various services, including search functionality. Benoit Dupin, Apple's Senior Director of machine learning and AI, took the stage to discuss this unexpected partnership, marking a rare instance of Apple publicly acknowledging a supplier relationship
1
.Long-standing Partnership and Efficiency Gains
Apple's relationship with AWS spans over a decade, powering services such as Siri, Apple Maps, and Apple Music. The tech giant has been leveraging AWS's Graviton and Inferentia chips, resulting in significant efficiency improvements. Dupin reported a 40% efficiency gain in searches after migrating from x86 to Graviton instances
2
.Exploring Trainium2 for AI Model Pre-training
Apple is now evaluating Amazon's latest AI chip, Trainium2, for potential use in pre-training its AI models, including those for Apple Intelligence. Early assessments suggest up to a 50% improvement in pre-training efficiency
3
. This move could significantly reduce costs and allow Apple to train more models within the same budget.Apple's Unique Approach to AI Processing
Unlike other companies that rely heavily on cloud-based processing, Apple's strategy involves performing as much processing as possible on-device using its own chips. For more complex queries, Apple uses its own M-series chips in Apple-operated servers
4
. This approach differs from the industry norm of using large clusters of NVIDIA GPU-based servers.Implications for the AI Chip Market
Apple's adoption of Amazon's custom chips could encourage other companies to explore alternatives to NVIDIA's dominance in the AI chip market. This shift might lead to more affordable options and increased competition in the sector
5
.Related Stories
Privacy Concerns and Clarifications
While some users might be concerned about privacy implications, it's important to note that Apple's use of AWS chips is primarily for model training and not for processing user queries. Apple continues to prioritize on-device processing and uses its Private Cloud Compute platform for cloud-based tasks that require high security and privacy
3
.Future of Apple Intelligence
As Apple continues to develop its AI capabilities, including the recent launch of Apple Intelligence features, the collaboration with AWS could play a crucial role in scaling and improving these services. The partnership demonstrates Apple's commitment to leveraging cutting-edge technology while maintaining its focus on user privacy and efficient processing
2
.References
Summarized by
Navi
Related Stories
Recent Highlights
1
AI Hallucination Nearly Sparked US Military Confrontation With Chinese Ship in Middle East
Technology
2
OpenAI AI Agent Hacks Australian Government Healthcare Website in First-of-Its-Kind Breach
Technology
3
AI leaders warn UN Security Council of existential risks to humanity, call for global safeguards
Policy and Regulation
Recent Highlights
Today's Top Stories
Don’t drown in AI news. We cut through the noise - filtering, ranking and summarizing the most important AI news, breakthroughs and research daily. Follow topics that matter to you and stay ahead.
