Google Gemini to Enable Hands-Free Calls and Texts on Locked Android Devices

New Google Gemini feature to allow calls in locked devices: Report

Disclaimer: This content generated by AI & may have errors or hallucinations. Edit before use. Read our Terms of use Google is developing a feature that will enable users to make phone calls and send texts with Gemini when their phone is locked, according to a report by Android Authority. An APK teardown revealed hints of this upcoming functionality. The report identified a new toggle in beta version that allows users to choose whether Gemini can make calls and send messages while their phone is locked. If enabled, Gemini will still prompt for phone unlock when a response contains personal information from apps like Gmail. Currently, Gemini can manage calls and texts when the phone is unlocked, but only Google Assistant can perform these actions when the device is locked. An APK teardown is the process of examining the contents of an Android Package Kit (APK) file. This involves unpacking the APK to analyze its code, resources, and structure. Developers and analysts conduct teardowns to uncover new features, changes, or hidden functionalities in apps before their official release. It helps in understanding how an app works and can provide insights into upcoming features or improvements. As with any APK teardown, it's important to note that there is no certainty that these features or visual updates will ultimately be implemented. Google Gemini claims to offer the capability to handle up to 1 million context tokens. Having a 1 million token context window means it can retain and process up to 1 million tokens when generating responses. A token represents a unit of input that AI models process, which can include a word, letters, punctuation, and more. The context window refers to the amount of information an AI model can consider at once, functioning as the model's memory for a conversation. If a model has a small context window, it may not retain all relevant information, which can lead to less accurate responses. Gemini Pro 1.5 features a context window of 1 million tokens, enabling it to recall or consider that many tokens in its responses. This larger context allows the model to take in more information from prompts, resulting in outputs that are more consistent and relevant. In a study, Karpinska and researchers from the Allen Institute for AI and Princeton tested AI models on true/false statements about contemporary fiction books. Researchers selected specific contemporary fiction books to ensure that participants or AI models wouldn't need to rely on what they already knew about the books. One book, approximately 260,000 words long, revealed that Gemini 1.5 Pro answered correctly 46.7% of the time, while Flash managed only 20%. Both models struggled to verify claims requiring comprehension of larger text portions and often failed to recognize implicit information that humans easily understand. Notably, the studies testing the 1-million-token context versions of Gemini have not undergone peer review. This raises concerns about Google overpromising with Gemini, especially as none of the tested models, including OpenAI's GPT-4o and Anthropic's Claude 3.5 Sonnet, performed well, despite Google prominently advertising its context window capabilities.

Gemini will soon call and text for you, without you needing to unlock your phone

Google is continuing to infuse the Gemini Live AI assistant across Android phones with the ability to make calls and send messages, even when your phone is locked, on its way. As discovered in a piece of as-yet unreleased code by Android Authority, the update would further cement Gemini as the replacement for Google Assistant. Controlling the phone while it is locked is a signature feature of Gemini Live. You could already talk to the AI and ask it questions when your phone is locked, but currently, only Google Assistant can send messages or make calls without unlocking the device. The unreleased code points to Gemini getting that option, too. According to the images in the code, Gemini's settings will have a switch permitting Gemini to send messages or make calls from locked devices. When activated, you could ask the AI to text or call people before unlocking the phone, though if you want to see a response with personal information, you'll have to unlock the phone as a security measure. The appeal for users to have Gemini able to communicate from locked devices is that it makes hands-free operation possible, which is ideal when you're driving or busy in some other way. The code in development also heralds changes in the look of Gemini, simplifying the interface in some ways. For instance, the floating text box will expand vertically so you can see all the text, and Gemini Extensions will be grouped by category to make them easier to find. There are also fewer example commands for the categories, only one instead of three.

Gemini on Android may soon become a lot better at making calls and sending texts

Google is finally fixing one of the most frustrating things about Gemini's AI image generation Key Takeaways Google Gemini may soon get the ability to make calls and send texts even when the phone is locked, according to an APK teardown. You may still need to unlock the phone when a response includes personal information from apps. Gemini may also be getting new UI changes soon, which could include a more minimal floating overlay that expands vertically as you input text. Google has gone all in on AI this year, with Gemini as its core focus. The AI model has been integrated across the company's services and has even replaced Google Assistant as the default on Android. However, it still lacks many features available on Google Assistant, and it's practically useless when your phone is locked. Google is apparently looking to change that, as an APK teardown suggests that Gemini will soon let you make phone calls and send texts even if your phone is locked. Related Pixel 9's Screenshots app finally gets the Gemini integration it should've had all along Searching screenshots just got easier Android Authority has spotted a new toggle in the Google app that will let you decide if you want Gemini to make calls and send messages while your phone is locked. Even if you turn this feature on, Gemini will still ask you to unlock your phone when a response includes personal information from apps, like Gmail messages. Right now, Gemini can already handle calls and texts if your phone is unlocked, but only Google Assistant can do it when the device is locked. Close This seems to be one of many new features coming to Gemini. Earlier this month, Mishaal Rahman spotted a hidden flag in the latest Android 15 QPR1 Beta 2, presumably providing a way to access Gemini from the lock screen. Google is also reportedly testing Gemini extensions for WhatsApp, Spotify, and Google Messages on Android, which will help these apps work better with the AI assistant. Gemini could also get UI changes Close Android Authority also spotted several UI changes coming to Gemini. First up is a tweak to the floating Gemini overlay, making it more minimal than ever. As you type, the box will expand vertically to show all of your text. The second change is that Gemini extensions are now neatly organized into categories like Communication, Device Control, Travel, Media, and Productivity. Related Google is finally fixing one of the most frustrating things about Gemini's AI image generation This is squarey good 4

Gemini Might Let You Make Calls, Send Messages on Locked Devices

Gemini extensions are also said to be separated into categories Gemini AI assistant, the recently added artificial intelligence (AI) virtual assistant for Android smartphones, is reportedly getting new capabilities. Ever since its release earlier this year, one of the major concern was lack of integration with first-party and third-party apps. Over the months, the Mountain View-based tech giant solved some of the issues with various extensions that support access to different apps and functionalities. Now, a new report claims that Gemini on Android devices will be able to make calls and send messages from the lock screen. According to an Android Authority report, the new Gemini AI assistant features were spotted in the Google app beta version 15.42.30.28.arm64. The features are not currently visible and were found during the Android application package (APK) teardown process. Calling and messaging feature on lock screen via Gemini Photo Credit: Android Authority The publication also shared a screenshot of the feature. Based on the screenshot, a new option has reportedly appeared in the Gemini on the lock screen menu in Gemini's Settings. This new option is titled "Make calls and send messages without unlocking" followed by a toggle switch. Users can reportedly turn it on if they wish to use this functionalities. Notably, currently users can make calls and send messages even when their devices are locked using Google Assistant. However, this new feature reportedly extends the capability to the AI-powered virtual assistant as well. As per the screenshot, users will still have to unlock the device to see incoming messages that contain personal content. Redesigned Gemini AI assistant interface Photo Credit: Android Authority Additionally, Google is reportedly also improving the floating Gemini text field overlay. Based on another screenshot shared, the new interface is a slimmer text box with two separate boxes that contain the options "Ask about this page" and "Summarise this page". This new design reportedly replaces the large floating box which users currently get. Further, the publication claimed that the extensions page of Gemini AI assistant is also getting a minor makeover. Instead of showing all the extensions in the same space, the new design reportedly separates the extensions into different categories. Some of the categories are said to be Communication, Device Control, Travel, Media, and Productivity. It is currently not known when these features might be rolled out to users.

Gemini's Latest Trick Will Let You Make Calls Without Unlocking Your Phone

Additionally, the Gemini floating overlay will soon get a more minimal look. Earlier this year, when Gemini replaced Google Assistant on most phones, it wasn't as intuitive and missed out on a lot of integrations. Gemini still isn't quite there and doesn't let you make calls or drop texts without having to unlock your phone, which is quite a limitation. Well, from the looks of it, that will change soon. Soon, Gemini won't require you to unlock your phone for those actions anymore. Folks over at Android Authority carried out a teardown of the Google app's 15.42.30.28.arm64 beta version, which revealed this piece of information. Most importantly, there will be a new on/off toggle. This will give users control over whether they want the functionality or not in the first place. Even with the feature toggled on, Android Authority notes that Google displays the message, "Gemini will still ask you to unlock when a response contains personal content, such as your Gmail messages, from apps you use". Gemini anyway doesn't handle calls or texts and simply triggers the Assistant to take over and do those for you. This finding states that Gemini will be able to do so even with your phone locked, which is quite convenient. If I'm already unlocking my phone to ask Gemini to call or text someone, I'd rather do those manually anyway. So, this is a much-welcome change. For example, let's say that you're cooking, and your hands are full. In that case, you can simply summon Gemini from the lock screen to call or text someone. Super useful, if you ask me. However, that's not the only change spotted. The floating Gemini overlay will most likely go through a design change which makes it more minimalistic. Currently, we see the entire expanded window right away. Going by what the report states, the overlay is now narrower and will expand as you type away your prompt. With Gemini getting support for more and more integrations, it will be quite interesting to see how helpful summoning the AI without unlocking the phone can further be. What do you think about this? Drop your thoughts in the comments down below!