2 Sources
[1]
Gemini in Chrome is getting yet another version of Circle to Search
Users will find a new "Select from screen" option when providing content for Gemini to see. Google is clearly enamored with the idea of using screen content to initiate searches, and over the years we've seen variation after variation on this same theme, from Google Lens to Circle to Search. Google's never been a company to shy away from a little redundancy, and this week it's sharing its very latest tool for pulling off this same sort of trick. Earlier this week, Google updated its Gemini in Chrome support pages to introduce a new "Select from screen" tool for Chrome on the desktop. Accessing it is pretty straightforward, with users needing to first click "Ask Gemini," then hitting the plus sign for Gemini's Add menu. Here, you can finally choose "Select from screen" to start drawing a box around the content you want Gemini looking at. That include multiple screen areas at once. When you have them all highlighted, you can go ahead and present Gemini with your prompt. That's all there is to using it, and as you can likely see, this already feels very close to Chrome's integration with Google Lens, only here leaning harder on Gemini, while Lens takes you to a regular Google Search page -- to be fair, one where you can always still engage with AI Mode. You obviously need to have Gemini in Chrome enabled to take advantage of this input feature, and that requires being signed in to the browser with a Google account -- it won't work in Incognito. If that's a concern of yours, Chrome's Lens support still works without an account, even in Incognito. Chrome users should start seeing "Select from screen" available in their browsers as of now. If you're not getting it (and you're positive you have Gemini in Chrome enabled in the first place), make sure you've updated to the most recent Chrome 149 release.
[2]
Gemini in Chrome can now see exactly what you're looking at on screen
Google's new "Select from screen" tool makes it easier to ask Gemini questions about text and images in a browser tab. Google is making Gemini a lot more aware of what's happening inside Chrome. The company has started rolling out a new "Select from screen" feature that lets users highlight specific text or images from a webpage and send them directly to Gemini, making conversations with the AI assistant far more contextual. Gemini can now focus on exactly what users want to ask about The new feature appears inside Gemini in Chrome's "+" menu and works much like a built-in screenshot tool. Once activated, users can select any text or image visible in the current browser tab, which is then automatically attached to a Gemini prompt. Instead of manually describing what's on a webpage, users can simply point Gemini at the exact content they want help with. Google is rolling out the capability as part of Chrome 149, although some users may need to restart their browser before it appears. The update continues Google's push to make Gemini feel less like a standalone chatbot and more like an assistant that's aware of what users are actively doing. The timing is also interesting because Google announced another major Gemini upgrade on the same day. Developers can now access computer use capabilities directly through Gemini 3.5 Flash, allowing AI agents to see, reason, and take actions across browsers, mobile apps, and desktop environments without relying on a separate model. Google says the integration improves long-horizon tasks such as software testing, enterprise workflows, and other multi-step automation jobs. This feels like Google's answer to "AI should know what I'm looking at" Interestingly, this update is less about a new feature and more about removing friction. By letting Gemini understand exactly what's on screen and interact with it directly, Google is moving beyond the traditional chatbot experience toward an AI assistant that can understand context, anticipate intent, and help users complete tasks rather than simply answer questions.
Share
Copy Link
Google launched a Select from screen feature for Gemini in Chrome, enabling users to highlight text and images from webpages and send them directly to the AI assistant. Available in Chrome 149, the tool removes friction by letting Gemini understand exactly what's on screen without manual descriptions, marking another step in Google's push to make AI-driven search and interaction tools more contextual.
Google has begun rolling out a new Select from screen feature for Gemini in Chrome, allowing users to highlight specific screen content and send it directly to the AI assistant for contextual analysis. The update, available as part of Chrome 149, represents Google's latest effort to integrate AI-driven search and interaction tools more deeply into the browsing experience
1
2
.
Source: Android Authority
Accessing the tool is straightforward. Users need to click Ask Gemini, then hit the plus sign to open Gemini's Add menu, where they can select the new "Select from screen" option. This activates a box-drawing tool that lets users highlight text, images, or multiple areas of on-screen content simultaneously. Once highlighted, users can present Gemini with their prompt, and the AI assistant will analyze the selected content without requiring manual descriptions
1
.The new capability feels similar to Chrome's existing integration with Google Lens, but with a crucial distinction. While Google Lens directs users to a regular Google Search page where they can engage with AI Mode, the Select from screen feature leans harder on Gemini in Chrome, keeping the interaction within the AI assistant's conversational interface
1
. This approach reflects Google's strategy to make the Gemini AI assistant feel less like a standalone chatbot and more like an integrated tool that understands what users are actively doing[2](https://www.digitaltrends.com/computing/gemini-in-chrome-can-now-see-exactly-what-you're looking-at-on-screen/).The feature joins Google's growing collection of screen-based search tools, including Google Lens and Circle to Search. While this might seem redundant, each tool serves slightly different use cases and contexts, though they all share the same core concept of using visual content to initiate searches
1
.To use the Select from screen feature, users must have Gemini in Chrome enabled and be signed in with a Google account. The AI-powered functionality won't work in Incognito mode, which may concern privacy-conscious users. However, Chrome's Google Lens support remains available without an account requirement, even in Incognito browsing
1
.The feature is rolling out now to Chrome users who have updated to Chrome 149. Some users may need to restart their browser before the option appears in the Gemini interface[2](https://www.digitaltrends.com/computing/gemini-in-chrome-can-now-see-exactly-what-you're looking-at-on-screen/).
The timing of this release coincides with another significant Gemini upgrade announced the same day. Developers can now access computer use capabilities directly through Gemini 3.5 Flash, enabling AI agents to see, reason, and take actions across browsers, mobile apps, and desktop environments. Google indicates this integration improves long-horizon tasks such as software testing, enterprise workflows, and multi-step automation jobs[2](https://www.digitaltrends.com/computing/gemini-in-chrome-can-now-see-exactly-what-you're looking-at-on-screen/).
This update signals Google's broader ambition to remove friction from AI interactions. By enabling Gemini to understand context and interact with on-screen content directly, Google is moving toward an AI assistant that can anticipate intent and help users complete tasks rather than simply answer questions. The focus on user experience improvements suggests Google is responding to the growing expectation that AI should understand what users are looking at without requiring extensive manual input[2](https://www.digitaltrends.com/computing/gemini-in-chrome-can-now-see-exactly-what-you're looking-at-on-screen/).
Summarized by
Navi
[1]
[2]
1
Policy and Regulation

2
Policy and Regulation

3
Policy and Regulation
