Gemini in Chrome gets Select from Screen feature to analyze on-screen content directly

Google Introduces Select from Screen Feature for Gemini in Chrome

Google has begun rolling out a new Select from screen feature for Gemini in Chrome, allowing users to highlight specific screen content and send it directly to the AI assistant for contextual analysis. The update, available as part of Chrome 149, represents Google's latest effort to integrate AI-driven search and interaction tools more deeply into the browsing experience1

1

2

2

.

Accessing the tool is straightforward. Users need to click Ask Gemini, then hit the plus sign to open Gemini's Add menu, where they can select the new "Select from screen" option. This activates a box-drawing tool that lets users highlight text, images, or multiple areas of on-screen content simultaneously. Once highlighted, users can present Gemini with their prompt, and the AI assistant will analyze the selected content without requiring manual descriptions1

1

.

How Select from Screen Differs from Existing Tools

The new capability feels similar to Chrome's existing integration with Google Lens, but with a crucial distinction. While Google Lens directs users to a regular Google Search page where they can engage with AI Mode, the Select from screen feature leans harder on Gemini in Chrome, keeping the interaction within the AI assistant's conversational interface1

1

. This approach reflects Google's strategy to make the Gemini AI assistant feel less like a standalone chatbot and more like an integrated tool that understands what users are actively doing[2](https://www.digitaltrends.com/computing/gemini-in-chrome-can-now-see-exactly-what-you're looking-at-on-screen/).

The feature joins Google's growing collection of screen-based search tools, including Google Lens and Circle to Search. While this might seem redundant, each tool serves slightly different use cases and contexts, though they all share the same core concept of using visual content to initiate searches1

1

.

Requirements and Availability

To use the Select from screen feature, users must have Gemini in Chrome enabled and be signed in with a Google account. The AI-powered functionality won't work in Incognito mode, which may concern privacy-conscious users. However, Chrome's Google Lens support remains available without an account requirement, even in Incognito browsing1

1

.

The feature is rolling out now to Chrome users who have updated to Chrome 149. Some users may need to restart their browser before the option appears in the Gemini interface[2](https://www.digitaltrends.com/computing/gemini-in-chrome-can-now-see-exactly-what-you're looking-at-on-screen/).

Broader Context and Future Implications

The timing of this release coincides with another significant Gemini upgrade announced the same day. Developers can now access computer use capabilities directly through Gemini 3.5 Flash, enabling AI agents to see, reason, and take actions across browsers, mobile apps, and desktop environments. Google indicates this integration improves long-horizon tasks such as software testing, enterprise workflows, and multi-step automation jobs[2](https://www.digitaltrends.com/computing/gemini-in-chrome-can-now-see-exactly-what-you're looking-at-on-screen/).

This update signals Google's broader ambition to remove friction from AI interactions. By enabling Gemini to understand context and interact with on-screen content directly, Google is moving toward an AI assistant that can anticipate intent and help users complete tasks rather than simply answer questions. The focus on user experience improvements suggests Google is responding to the growing expectation that AI should understand what users are looking at without requiring extensive manual input[2](https://www.digitaltrends.com/computing/gemini-in-chrome-can-now-see-exactly-what-you're looking-at-on-screen/).