Google Gemini Set to Revolutionize Android 16 with Advanced In-App Task Automation

Google Gemini Enhances Android 16 by Taking Over In-App Tasks

Gemini AI on Android 16 Set to Revolutionize In-App Task Automation Google is set to take a major step forward in smartphone AI capabilities with the Android 16 update set to launch with an improved version of Gemini AI software. This upgrade turns Gemini into an Agentic AI Assistant, which will allow the app to autonomously complete in-app tasks for the client. Android Authority has reported that in Android 16, the company is set to launch a completely revolutionary feature known as "app functions." These are specific tools provided by third apps that Gemini AI can call and activate in response to input from the user without the need for the user to open the third-party app. For example, as a user of a food ordering program, Gemini could order directly and remove the need for an additional step. This signifies a significant advancement over what Gemini AI can achieve now, where the bot can only assist with specific applications and at the base function. At the moment, only several third-party apps, including WhatsApp, as well as native apps by Google are integrated with Gemini Extensions and enable the assistant to communicate with them. Furthermore, it includes certain basic options, which are launching apps and tweaking settings. Nevertheless, even complex multiple-step processing still needs user interaction. The new app functions feature exposed in the Android 16's developer documentation will help to fill this gap and let Gemini AI perform many more tasks non-impeded. Google defines app functions as "particular implementation that an app brings into a system and which the app provides for the use across the features of the system." However, the transformation process of Gemini does not end with control via in-app automated solutions. Google is also rumoured to be working on a larger action model under the project codename, Project Jarvis. The main purpose of this filter is to use this initiative to extend Gemini's functionality to web-based task automation. Actions such as ticket booking, basic web searches, and site browsing might someday be performed independently by Gemini with integration into the Google Chrome browser. As Google proceeds to work on Gemini AI, you can see that the company is working on reinventing the ways people use technology. From helping to automate tasks in applications to performing sophisticated actions in web interfaces, Gemini is on track to become an indispensable component of the new generation of smartphone capabilities. The Android 16 update, along with the further development of Gemini AI, creates a significant milestone in AI in making smartphones intelligent, effective and easier to use.

Android 16 could give Gemini more control over apps - and other AI upgrades are rumored too

The Google Gemini app on Android has gradually been getting more and more of the features and functions of Google Assistant - on top of its generative AI capabilities - and it seems even more upgrades are on the way. First up, as reported by Android Authority, there are new APIs (Application Programming Interfaces) in the developer preview of Android 16 that could give Gemini more control over what's happening inside other apps on your device. If app developers make use of these APIs, Gemini could get the ability to order takeaway food or call a cab for you, for example - the sort of AI agent upgrade that's now being talked about as the next stage for these artificial intelligence bots. Right now, Gemini makes use of extensions to interface with apps like YouTube, Google Maps, Gmail, Spotify, and WhatsApp. However, Google can't build these for every single Android app - APIs would let developers do the job themselves. This AI agent upgrade for Android 16 isn't the only Gemini leak we've come across this weekend. As per some more code digging by the team at Android Authority, the advanced Gemini Live voice mode could soon let you dig deeper into YouTube videos. The idea is you could have a natural conversation with Gemini Live about a video you're watching on your phone, in addition to the Ask about this video feature that's already available if you need explanations or summaries. Lastly, a potential interface change has been spotted for Gemini Live, again by Android Authority. Hidden code in the Android app suggests you'll soon be able to pause and resume chats from a notification in the status bar. The advantage of using Gemini Live over the other Gemini input modes is you can talk with it as you would a real person - with interruptions, pauses, and so on - and these tweaks would make the AI app even more useful.

Android 16 could give Gemini the power over apps Assistant never got

This could let Gemini act as an AI agent on your phone, which is something Google originally promised the Pixel 4's new Google Assistant would do. Google is giving everything it has to make its Gemini chatbot and large language model more successful, including integrating it across its entire product suite. On Android, Gemini has become the default assistant service on many devices, and the number of things it can do continues to grow with each update. While Gemini can interact with some external services, its ability to control Android apps is very limited at the moment. However, that could change in a big way with next year's Android 16 release, which is set to include a new API that lets services like Gemini perform actions on behalf of users inside applications.

Google is prepping Gemini to take action inside of apps

Google released the first Android 16 developer preview earlier this week and keen-eyed observers are already uncovering interesting tidbits, including one that hints about a much more useful future for Google's AI assistant. In Android Authority, Mishaal Rahman writes about a mysterious new API in Android 16 called "app functions," which appears to give Gemini Assistant agentic-like abilities to take action in apps. It sounds awfully similar to the upgraded "app intents" Apple supports in iOS 18, and it's exactly the kind of thing that could make AI assistants much more useful than they are in their current state.

Android 16 might let Gemini order food for you

Gemini's newest extension finally makes it a decent Google Assistant alternative Key Takeaways Android 16 might introduce a new API allowing Gemini to control apps directly, such as booking flights or ordering food. Recent developer docs in Android 16 DP1 suggest a new method of app functions integrated into system features. The mysterious API hints at app functions like ordering food, signaling the potential for an improved digital assistant. ✕ Remove Ads Google is all-in on Gemini. The powerful AI is integrated everywhere, and it is even the default voice assistant on many of the latest Android phones. But so far, it has lacked the ability to control parts of the phone and third party apps the same way Google Assistant could. That is, until Android 16 drops next year. Related Google Gemini tips and tricks: Put Google's most capable AI model to good use Not sure what's up with Gemini? Here are the goods Google looks set to include a new API that lets services like Gemini perform actions on behalf of users inside applications (via Android Authority). A lot of details are still missing, but Android 16s new app functions feature will let Gemini control apps in a way Google Assistant never could. Mysterious app functions in developer docs Source: Android Authority ✕ Remove Ads It all began when a mysterious set of APIs appeared in Google's developer docs following the Android 16 DP1 earlier this week. The docs mention an app's functionality can be integrated into various system features, hinting at a new method of app functions. Gemini currently depends on extensions to interact with external services. For example, there's a Calendar extension, and a web services extension to give Gemini access to Google Hotels, and so on. Gemini is able to pull data from these extensions, but these extensions only let Gemini call on the backend APIs, rather than control the app itself. You can ask Gemini to tell you when your flight arrives, but you can't ask it to book a flight for you. But the mystery documentation hints at a new API that lets apps work directly with Gemini. Google's description of app functions remains vague, but there is an example of an app function in the doc. ✕ Remove Ads "For example, a function to order food could be identified as 'order food.'" the example reads. It seems like apps could create functions by defining a service that Gemini could execute. This could be the assistant we have been dreaming about Google teased a new Google Assistant back in 2019, using your voice alone to multitask across apps thanks to a helpful, personal digital assistant. It sounds a lot like what AI agents today are promising. Given everything Google has been working on, it seems likely we could finally see a true AI use app functions with Android 16 on next year's Pixel. ✕ Remove Ads