Google Enhances Gemini AI with New Extensions for Popular Apps

Google Assistant features could be turned into Gemini extensions - Phandroid

Google is heavily invested and focused on AI, particularly its Gemini AI which has made its way into various products and services like Android. On Android, it has basically replaced Google's old virtual assistant, Google Assistant. In some ways it's good, others way not so good, but there is good news for those who miss Google Assistant and want those features in Gemini. According to a report from Assemble Debug in collaboration with Android Authority, it seems that Google is working on turning some Assistant actions into extensions for Gemini. Prior to this, when you wanted Gemini to perform certain actions like sending messages, it would basically rely on Google Assistant to pull it off. With these extensions, Gemini will eventually learn your preferences when it comes to performing certain tasks. For example, if you're someone that primarily uses WhatsApp to send messages, Gemini will understand that WhatsApp is your messenger of choice so you don't have to be so specific about your requests. In the report, they found that it also works with music apps such as Spotify. If the Spotify Extension is enabled, when users as Gemini to play a song, it will choose Spotify to play the song instead of another app like YouTube Music. These extensions aren't live yet as they were spotted in the Google app beta, so we'll probably have to wait for the public rollout to get a better idea of what it will work.

Gemini is taking over some more Google Assistant tasks

Upcoming Gemini Extensions will handle your WhatsApp and Spotify requests Google continues to replace Google Assistant features using its Gemini AI models and branding, as discovered in as-yet unreleased code by Android Authority. The tech giant's infusion of Gemini is rolling throughout its product line. Upcoming Gemini Extensions will take over Google Assistant integrations with apps including Google Messages, Spotify, and WhatsApp. These Gemini extensions are designed to take over for those Google Assistant integrations while promising to personalize the interaction beyond the capacity of the older AI assistant. Right now, if you ask your Android device or Google app to play a song on Spotify or send a message via WhatsApp, Google Assistant completes the task. The code in the beta version of the Google app lays out how Gemini will pick up that role through Extensions running independently from Google Assistant. It's not just a cosmetic shift. The Spotify Extension works like the YouTube Music Gemini Extension, playing a song upon request and showing an image of the song that you can tap to open Spotify. The Gemini Extensions also allow you to use much more casual language than Google Assistant when asking Google to play music on Spotify or call someone with WhatsApp. They also speed up the process by eliminating some of the follow-up clarifications required by Google Assistant. The AI will adapt to your preferences, remembering what apps you favor for carrying out tasks. So, if you always use WhatsApp to call certain people and your phone to call others, you'll be able to ask the AI to call one of them without specifying which app to use, and it will automatically pick the right one. The same goes for asking Gemini to play a song on YouTube Music or Spotify. You can also manually adjust which apps are used for which tasks. The Gemini Extensions being in beta means they can't do everything you might want as of yet. Gemini can't read or show old messages when asked yet, though that may be included when the final version of the update rolls out. When it does arrive, you might not find the update groundbreaking, but if you pay attention, you'll likely notice how much better Google's voice AI is at understanding what you want it to do and how it is completing your requests faster than you remember. Gemini Extensions are key to Google's efforts to encourage people to use Gemini by spreading the AI everywhere. Gemini is becoming the foundation for both Google products and how they link to third-party apps and services. Google Assistant as both a brand and a product is being superseded, though marketing is definitely as much a part of that shift as actual technical upgrades.

You Might Be Able to Text on WhatsApp With Gemini AI Assistant

The Spotify extension is said to work for both free and Premium accounts Gemini virtual assistant on Android is reportedly getting new capabilities. The artificial intelligence (AI) chatbot was integrated into the operating system as an alternative to Google Assistant. With AI capabilities, the Gemini AI assistant could answer queries, generate text, and search the web. However, its third-party app integration was limited, resulting in it not being very useful for general use cases. The tech giant changed it with extensions that allowed the AI chatbot to access certain apps. Now, Gemini is said to be getting extension capabilities for WhatsApp and Spotify. According to an Android Authority report, the new capabilities were spotted in the Google app for Android beta version 15.40.31.29 by tipster AssembleDebug. This feature has not been rolled out, so beta testers will not be able to find it. However, after activating the extension, a new prompt card reportedly appeared explaining that Google Assistant actions are being replaced with Gemini Extensions. Gemini app activity is said to be used for actions such as picking a contact. Also, to use extensions, users will have to keep Gemini app activity turned on. Gemini extensions on Android Photo Credit: Android Authority/AssembleDebug The app will also track and find out which app the user prefers to call or text a specific contact, as per the report. Using this data, Gemini is said to automatically pick the preferred app by default. This preference can reportedly be changed, and any extension can be turned off in the activity menu. The tipster was reportedly able to activate the extension for WhatsApp. The new Gemini extension is said to let users send text messages to the specified contact using verbal prompts, just like Google Assistant. Upon invoking, the Gemini assistant interface reportedly shows an app card, which can be clicked to directly enter the app and check the message. The extension reportedly also allows users to modify messages before sending them and to make voice calls using the app. Coming to Spotify, the extension reportedly works for both free subscribers and Premium users. Users can reportedly prompt Gemini to play a song on Spotify and it will automatically pick and begin playing the song. Just like WhatsApp, it is said that the Spotify card appears after the AI carries out the command, and the user can tap on the card to enter the selected song within the app.

More Google Assistant actions are becoming Gemini Extensions on your Android phone

Users can manage Gemini's behavior based on their activity, such as choosing which Extension to use for calling or messaging contacts and disabling any unwanted Extensions. Google is converting more Assistant actions into Extensions that will be powered by Gemini. Previously, when you asked Gemini to send a WhatsApp message or a text through Google Messages, It relied on Google Assistant to perform the action. This is changing now with new Extensions for Gemini. The AI is also getting smarter and will soon start learning your Extension preferences for performing certain tasks. Android Authority contributor Assemble Debug managed to activate new Gemini Extensions in the Google app's beta version 15.40.31.29. A screenshot below shows a prompt explaining how more Google Assistant actions are converting to Extensions. Users' Gemini activity will be used for actions like choosing a contact. It's mandatory to have the Gemini Apps Activity turned on for using Extensions. More importantly, Gemini will also soon learn which Extension you use for calling and messaging each of your contacts. Users can manage this in their activity, ask for a different Extension, or turn off any Extension they want. The Google Messages Extension works in exactly the same way as the WhatsApp Extension. In its description, Google notes that the Extension is capable of sending and reading messages, but as of now, it can only send the messages, not read them. For instance, we tried giving Gemini commands like "show me my last message from Google message," but it did not throw up a result. The Spotify Extension is similar to the YouTube Music Extension. It works for both free and Premium Spotify users. When you ask Gemini to play a song, and you've enabled the Spotify Extension, it will start playing the song from Spotify and show you a thumbnail. Tapping the Spotify thumbnail will take you straight to the app. Please note that we were able to activate these new Extensions by tinkering around with the Google app beta. They are not rolling out widely just yet, but we will inform you when they become available to everyone.

Gemini might finally work better with WhatsApp, Spotify, and Messages on your Android

Key Takeaways Gemini on Android is gaining native extensions for WhatsApp, Spotify, and Google Messages. These extensions allow for smoother interactions and deeper integration with these apps. Google is actively working on expanding Gemini's capabilities and personalization features. Gemini has been one of Google's top priorities this year, gradually being integrated across the company's services and even replacing Google Assistant as the default on Android. However, despite the transition, Gemini has lacked several core features that Google Assistant used to offer. Google has started addressing these gaps -- recently adding support for Google Assistant Routines -- and now appears to be working on expanding Gemini's capabilities even further. Related How to create custom AI chatbots with Gemini Gems Build a personalized chatbot using Gemini Gems 2 A recent leak from Assemble Debug (via Android Authority) reveals that Google is testing Gemini extensions for WhatsApp, Spotify, and Google Messages on Android. Previously, Google Assistant Actions allowed users to interact with apps directly, such as sending a WhatsApp message to a contact. While Gemini can already perform similar tasks using Google Assistant, it's now gaining its own native extensions, which should enable smoother interactions and deeper integration with these apps. Although the feature is still being tested, the leaker managed to activate the extensions on the Google app for Android (beta version 15.40.31.29). The screenshot reveals that Google Assistant actions are being transitioned into Gemini extensions. It also indicates that Gemini will learn which extensions you use for specific tasks, like calling or messaging particular contacts, to offer a more personalized experience. Your favorite apps will soon integrate better with Gemini Close The extensions function exactly as intended. For example, when you ask Gemini to send a message via WhatsApp, it now uses the native extension to open the app directly instead of relying on Google Assistant Actions. It's noticeably faster compared to the current implementation as well. The same applies to the extensions for Spotify and Google Messages. And for those wondering, the Spotify extension works even for those on the free plan. Related I'm convinced AI will take over, but not in the way you think We're outsourcing people skills 5 The feature is still in testing, and there's no official word on when it will roll out to the public. However, since the leaker managed to activate it with some tweaks, it's likely not far off. Regardless, it's good to see Google finally giving Gemini on Android the attention it needs.