Google Gemini Expands Capabilities with New Utilities Extension, Closing Gap with Google Assistant

Google Gemini is set to finally reach its full potential - and take over from Google Assistant - thanks to a major upgrade

Google Gemini is taking another step closer to becoming the fully-fledged virtual assistant that we all want thanks to a new update rolling out now called "Gemini Utilities Extension" that can control your Android mobile device and apps. While the update is on the way, it could take a few days to reach everybody with an Android device. The new update means that Gemini will be able to take over tasks like opening websites, apps, and settings that it currently has to farm out to Google Assistant. The Gemini Utilities Extension will work with apps on Android devices only, The full list of upgrades that the Gemini Utilities Extension contains includes setting timers and alarms, taking a photo or screenshot (even from the lock screen), and controlling media playback. While the Google Gemini app is a massively powerful upgrade to the original Google Assistant, giving you the ability to search your inbox, produce summaries, and provide helpful advice, Android devices are currently in a strange situation where the Gemini AI still has to revert back to Google Assistant it for some tasks, especially ones that require interaction with an app or Settings. Now, with Gemini Utilities Extension, you'll no longer need to rely on Google Assistant to perform these tasks. It's also important not to confuse Gemini with Gemini Live, which is Google's voice-controlled version of the AI, that enables you to have much more free-flowing conversations than the standard Gemini voice feature in the Gemini app allows. The improvements ushered in by the new Gemini Utilities Extension will not give the same powers to Gemini Live, which still can't interact with apps and settings on your device. There is still no news from Google about when we can expect upgrades to Gemini Live that will give it these capabilities. A note on the Gemini Apps help website says simply, "We're gradually releasing updates to Gemini Live, so the latest changes might not be available to you just yet."

Gemini's new extension brings back your favorite Google Assistant features on Android

This new extension for Gemini finally brings the app up to par with your old Google Assistant in terms of basic functionality and more. If you've been missing Google Assistant since Gemini took over, you'll want to know about a major upgrade coming to your phone. One of the biggest complaints about Gemini on Android is that it lacks a lot of the basic functionality that Google Assistant had like setting alarms and timers and controlling media. Also: Why I recommend this Google Pixel phone to most people A new "Utilities" extension aims to fix that. As Google explains, this tool lets you ask Gemini to handle certain actions on your device. You can use it to set and manage alarms and timers in your clock app, open websites, take photos and screenshots, control your media playback, browse or search for screenshots in Pixel Screenshots, and more. You can find the full list on Google's support page. Gemini can even handle multiple requests at once like "Turn my media volume and notification volume to [percentage] and turn on battery saver" or "take a photo with a 10s timer." Also: How to use Gemini to generate higher-quality AI images now In addition, several lock-screen-specific features are on the way, like the ability to set or silence alarms and timers, turn on and off your flashlight, enable Bluetooth, check your phone's battery level, or restart. Google included a small list of things that Gemini can't yet do: turn closed captioning on or off, change the language for media, find and open specific pages on a website, change Gemini's language, or use Find My Device. Utilities are only available on the Gemini mobile app for Android devices, and you will need to have Gemini as your primary phone assistant. Google is releasing it gradually, so if you don't see it right now (it wasn't available on my Pixel 8 Pro when I checked), you should see it soon. Also: You could win $25,000 for pushing Google's Gemini 1.5 to its limit You can check to see if you have Utilities by tapping your profile photo in the top right corner and looking for "Extensions."

Gemini Will Soon Be Able to Control Your Smartphone With This Extension

Gemini AI assistant is finally getting support for an extension that will allow it to perform various smartphone tasks. Dubbed the Utilities extension, it was first announced at the Google I/O and it can control first-party apps and functions such as alarm, timer, volume control, camera, and more. However, the Mountain View-based tech giant is rolling out the extension gradually and it might take a few weeks before all Android device users can see the capability. Ever since the launch of Gemini as an artificial intelligence (AI) assistant for Android devices, the chatbot has lacked some very crucial capabilities available with Google Assistant. For instance, it cannot open apps, click a picture using the phone's camera, or set an alarm. To fix this issue, Google announced a new Utilities extension earlier this year. In its support pages, the tech giant announced that the extension is finally being rolled out to users. However, there are some limitations. The feature is only available via the Gemini mobile app on Android smartphones. For the feature to work, users must have set Gemini as the default virtual assistant. Additionally, the Utilities extension only works with prompts in the English language for now. Also, since the feature is being gradually rolled out, some users might have to wait for some time before it becomes available for them. With this extension, Gemini AI assistant will be able to manage several tasks on the lock screen as well. Some of them include setting and silencing alarms, setting and stopping timers, turning on or off the flashlight, Bluetooth, DND and Battery Saver mode, checking the device's volume and battery level, turning off the device or restarting, and more. Google also revealed that the extension will let the AI assistant perform multiple actions with a single prompt. It can also open websites, apps, and the settings menu. Further, Gemini will also be able to open the Camera app and click a picture or capture a screenshot. This extension will also give Gemini the ability to control media playback including pause and play functions as well as moving to the previous or the next media. This will only work with the native media player, however, and may not work with apps such as Spotify or Apple Music. And finally, users will also be able to set alarms and timers with this feature.

Gemini's newest extension finally makes it a decent Google Assistant alternative

Key Takeaways The new Google Gemini Utilities extension adds more functionality. Gemini can now do much of what Google Assistant has been able to do for simple tasks. Google continues to work on replacing Assistant with Gemini, but there are many more tools that need to be added before that can happen. ✕ Remove Ads When Google Gemini was officially unveiled in late 2023 following the company's rebrand and relaunch of Bard, many quickly understood that Google would eventually merge all of Assistant's functions into Gemini in due time. However, we were extremely conflicted about Gemini as a Google Assistant replacement earlier this year, as it lacked many features that Assistant had been able to do for users since it launched. Not only that, but users had to select between one or the other as their phone's digital assistant. Things have gotten a lot better for Gemini converts today, as Google announced a new extension that handles much of what Gemini was lacking. Related ARTICLE: Google Gemini could soon get a lot more useful on your phone New Gemini extensions are incoming 4 ✕ Remove Ads Rolling out starting today, Android users who have selected Gemini as their phone's assistant will be able to ask the AI tool to do many things that Assistant has been able to do for years (via 9to5Google). From managing your alarms to opening apps and controlling your media, the Utilities extension will enable Gemini to handle these actions. In addition to setting Gemini as your primary assistant, users must enable Gemini Apps activity and ensure that the Utilities extension is set to on (by default, it is). Months in the making Source: Google ✕ Remove Ads Back in July, we said that Google was working on this extension, and it comes to the masses at an interesting time. In October, Google split up the Gemini and Assistant teams for better efficiency, merging the Gemini team with the DeepMind division, and rolling the Assistant teams into the new Platform and Devices division. This shows that Assistant and Gemini will continue to live on separately (even with a high amount of crossover in functionality), for now. This marked the third time (at least) this year alone that Google has given a different indication of its plans for both Gemini and Assistant. Back in August, at the Made by Google event, Gemini stole the spotlight and was announced as the default assistant on the Google Pixel 9 series. In September, Gemini got a lot better at creating tasks on Android, so while Google continues to shift its optics, the underlying message seems simple: Google Gemini will completely replace Google Assistant. It's only a matter of time. ✕ Remove Ads

Google Home finally gets Gemini support -- and it's about time

The Google Gemini app is getting a Google Home extension. This will allow you to use the AI assistant to interact with your smart home devices more conversationally. While you can already use a Google Nest device to issue voice commands, talking to Gemini feels more natural than the standard Google Assistant. The extension is currently in the Google Home Public Preview program so you can try it out. It also means it'll be coming to the app for all users soon, as the Public Preview is the last place new features will go before they launch. Before this update, you'd be bumped to the standard Google Assistant if you tried to use your smart home stuff with Gemini. It was a far less elegant solution than having smart home gadgets built right into the main app. Google's AI supports lighting, climate control, window coverings, TVs, speakers, and other types of devices. Unfortunately, there's still a relatively extensive list of devices it can't control, so you'll still be thrown to the Google Home app if you ask Gemini to work with security devices, including garage doors, locks, cameras, gates and other kinds of doors. Another important note is that the feature only works on Android phones and tablets -- Apple users are left out in the cold (since they can't control their smart thermostats). It also works in English only. If you want to try Gemini for Google Home, you must join the Public Preview program. Google offers a detailed guide with the required steps, and it's a painless process. Once in, you can read the Google support page about the Gemini extension to learn more about what it can and can't do. Google also added a nifty WhatApp Gemini extension that lets you make calls and send messages. It also updated the AI with Gemini Extensions for Messages and the Phone app, both of which work like WhatsApp.

Gemini AI Assistant Can Now Control Your Smart Home Devices

Gemini cannot complete security device actions that require a pin Gemini artificial intelligence (AI) assistant is getting support for a new extension that will allow users to control their smart home appliances. The AI-powered virtual assistant for Android devices has been receiving regular extension support to perform more tasks on the device and match the performance level of the older Google Assistant. Currently, Gemini assistant can manage Google Workspace apps, Google Maps, YouTube, YouTube Music, and more. It is also rumoured to get support for calling and messaging on the lock screen. In its support pages, Google detailed the new extension for its in-house AI chatbot Gemini. Android device users with the Gemini app installed and Gemini set as the default virtual assistant can access the Google Home extension. However, users must ascertain that the Gemini app as well as the smart home devices are both connected to the same Google account. Google said users will be able to access smart home devices such as lights, sockets, switches, air conditioning units, thermostats, fans, curtains, smart TVs, speakers, washing machines, and more. However, the extension cannot complete security device actions that require a pin, stream video feed from cameras or execute routines. Since Gemini is an AI chatbot, it does support natural language prompts that Google Assistant cannot. For instance, users can tell the virtual assistant "Set the dining room for a romantic date night" or "Set the AC to a good temperature for sleeping", and it can understand the requirements and complete the tasks. To use this functionality, users should first open the Gemini app and sign into their Google account. Then they can ask it to complete a task for smart devices. The app will prompt users to connect the Gemini app to Google Home, at which point users will need to turn on the extension and give the app permission to access and control the smart devices connected with the same account. Notably, the feature is currently available as a public preview and is available to those who have signed up for Google Home's Public Preview programme. The feature works with both text and audio inputs but can only accept English language prompts currently. Gemini AI assistant is currently not available on iOS.

Google is building smart home controls into Gemini

Google is adding a Google Home extension to the Gemini app, allowing you to control your smart home while chatting with the AI assistant. The update, which is available to Android users as part of Google Home's Public Preview program, will let you use natural language prompts, like "Set the dining room for a romantic date night" to adjust lighting, or "Help me clean up the kitchen" to turn on the vacuum. Previously, the Gemini app would open Google Assistant if you tried to control your smart home. With the new Google Home extension, you can perform actions across smart lighting, climate control, window coverings, TVs, speakers, and more from within the Gemini app. The extension in Gemini doesn't support all smart devices, however. As Google notes, it will link you to the Google Home app for controls related to security devices, including cameras, locks, gates, and doors. It also can't execute routines. Like Google, Amazon is also working to add support for natural language commands in Alexa. The company has already rolled out a preview containing elements of this update, but we'll likely have to wait until next year to see a full AI overhaul for Alexa. And while Apple is planning to upgrade Siri with Apple Intelligence, the assistant doesn't have a role in the smart home just yet. If you want access to the Google Home extension feature, you'll have to follow the steps to join the Google Home Public Preview. It's also only available in English for now. Then, to use the feature, sign in to the Gemini app with the same account you use with Google Home. From there, you can ask Gemini to perform a specific action, such as "turn on living room lights." Google says you may have to include "@Google Home" in your prompt if Gemini doesn't use the extension automatically.

Google Home's new Gemini Extension frees you to control your smart home with natural language

Inch by inch, Google Gemini is slowly spreading its AI reach across more and more of the company's apps and services. And as it does so, Gemini becomes more useful and more functional, to the point that it should one day be ready to replace Assistant. Maybe the most substantial way we see Gemini's influence grow is with the release of new Extensions, and this week we're getting our first taste of a bunch of powerful new ones. Probably the biggest one here is the Gemini Extension for Google Home. For as much as you can do with Home and all your connected devices, controlling it with Assistant can sometimes feel a little hit-or-miss; how many times has Assistant just completely whiffed on you when giving it what felt like a straightforward command? Thanks to Gemini, those sort of frustrations may soon be a thing of the past, as it offers the ability to control your smart home using natural language.

Google Gemini Rolls Out 'Utilities' Extension For Android: Here's What All You Can Do With It - Alphabet (NASDAQ:GOOG), Alphabet (NASDAQ:GOOGL)

Alphabet Inc.'s GOOG GOOGL Google Gemini app has introduced a "Utilities" extension for Android users. What Happened: Initially previewed at I/O 2024 in May, the Gemini Utilities Extension is now being rolled out. It replaces the Google Assistant fallback, enabling users to control alarms, timers, apps, media, and more. With Google's Clock app, Gemini supports conversational alarm and timer settings; third-party clock apps allow only basic settings. See Also: Trump Vs. Harris: Meet The Teens Using AI To Call 2024 Election Faster, Cheaper Than Pollsters Users can perform multiple actions in one prompt, such as adjusting volumes, enabling a battery saver, or taking a timed photo. The extension also opens websites, apps, settings, and control features like flashlight, volume, and brightness. Google is gradually releasing this extension, currently available for prompts in English only. The widespread availability of the extension is yet to be seen, noted 9To5Google. Subscribe to the Benzinga Tech Trends newsletter to get all the latest tech developments delivered to your inbox. Why It Matters: Google's generative AI platform, Gemini, is stepping up against key rivals like OpenAI's ChatGPT, Microsoft Corporation's MSFT Copilot, Anthropic's Claude, Meta Platform, Inc.'s META LLaMA, and Cohere Inc. Gemini has gained momentum through initiatives like the Gemini API Developer Competition. Its strengths include deep integration within the Google ecosystem. However, since its launch, Gemini has also faced major challenges, with critics highlighting issues of biased responses and inaccurate image generation. Last month, Alphabet reported third-quarter revenue of $88.27 billion, marking a 15% increase from the previous year and surpassing the Street consensus estimate of $86.31 billion, according to data from Benzinga Pro. At the time, Alphabet CEO Sundar Pichai announced that all seven Google platforms with over 2 billion users, including Google Maps, now run on Gemini models. Due to high demand, Gemini is also expanding to developers, starting with GitHub Copilot. Check out more of Benzinga's Consumer Tech coverage by following this link. Read Next: Palantir CEO Alex Karp Warns Europe Risks Doom Without AI Disclaimer: This content was partially produced with the help of AI tools and was reviewed and published by Benzinga editors. Market News and Data brought to you by Benzinga APIs

Google Is Working on Letting Gemini Control Your Smart Devices

Smart homes have gotten more intelligent over the years, but we still haven't quite reached the same level as old sci-fi movies where people could talk directly to a house AI. Fortunately, if Google plays its cards right, this technology may come sooner than you think. The company is working on letting Gemini interact with your smart home devices and tweak their settings based on your natural language prompts. ✕ Remove Ads Google Gemini's Home Integration Is Currently in the Testing Phase As announced on Google Nest Help, the newest Public Preview build for the Google Home app features a new extension for Gemini: With the Google Home extension, you can control your smart home devices with your Gemini mobile app. For example, you can write or say: 'Turn on/off all of the lights.' 'Help me clean up the kitchen' (to start the vacuum cleaner). 'Turn the thermostat to heat-cool mode.' At first glance, this may sound like commands you'd give a regular Google Home device. However, because Gemini runs off of an LLM, it can understand natural language prompts. This means it can take context from what you're saying and figure out the best course of action. ✕ Remove Ads For example, in Google's guide on controlling your smart home with Gemini, the company states that you can say "The sun is too bright in the living room" and Gemini will know to close the window coverings. Or you can say "Set the dining room for a romantic date night" and Gemini will do its best to set the scene. There are a few caveats with this new feature. For the time being, Gemini can only process English prompts, and it's not allowed to influence any smart security devices. If that sounds alright with you, check out how to join the Google Home Preview Program if you want to give this feature a try early. ✕ Remove Ads