2 Sources
[1]
Google Gemini introduces "Ask about this screen" feature on Android, note taking feature on Google Meet
Gemini has rolled out two new features for Android that were showcased earlier at Google I/O this year. Called 'Ask about this screen," the feature allows users to have queries about whatever is happening on the screen. There's also an "Ask about this video" feature which is compatible with
[2]
Google expands Gemini AI's onscreen awareness capability to more phones
Google is reportedly rolling out new Gemini AI assistant features on Android smartphones that allow users to ask Gemini questions related to what's on their display. Additionally, Gemini is gaining the ability to offer YouTube video summaries and respond to queries related to specific YouTube
Share
Copy Link
Google enhances Gemini AI with expanded 'Ask About This Screen' feature for Android and introduces note-taking capabilities in Google Meet, aiming to improve user productivity and information accessibility.

Google has announced a significant expansion of its Gemini AI's 'Ask About This Screen' feature, making it available on a wider range of Android devices. Initially exclusive to Pixel 8 Pro, this functionality is now accessible on devices running Android 12 or newer versions
1
. The feature allows users to interact with Gemini AI about the content displayed on their screen, enhancing the accessibility of information and improving user productivity.The 'Ask About This Screen' feature enables users to ask questions or seek explanations about the content visible on their device's screen. By simply long-pressing the power button or using the home button, users can activate this feature and engage with Gemini AI for instant insights
2
. This expansion brings advanced AI capabilities to a broader audience, potentially transforming how users interact with their devices and access information.In addition to the expanded 'Ask About This Screen' feature, Google has introduced a new note-taking capability powered by Gemini AI in Google Meet. This feature allows users to generate notes automatically during video calls, summarizing key points and action items
1
. The AI-generated notes can be easily shared with participants after the meeting, streamlining collaboration and ensuring important details are not missed.Google emphasizes that user privacy remains a top priority. The 'Ask About This Screen' feature processes information locally on the device, ensuring that sensitive data is not shared externally. Users have full control over when to activate the feature, maintaining their privacy and data security
2
.Related Stories
The expansion of Gemini AI's capabilities on Android devices signifies a growing trend of integrating advanced AI functionalities into everyday mobile experiences. This move by Google not only enhances user interaction with their devices but also sets a new standard for AI-assisted features in the mobile industry
1
.While the expanded 'Ask About This Screen' feature is rolling out to compatible Android devices, the note-taking feature in Google Meet is currently in the testing phase. Google plans to make these features more widely available in the coming months, potentially revolutionizing how users interact with their devices and manage information during video calls
2
.Summarized by
Navi
[1]
[2]
1
Science and Research

2
Technology
3
Technology