Google transforms the cursor with Magic Pointer, bringing AI interaction directly to your screen

DeepMind details Googlebook 'Magic Pointer' with demos you can try, also coming to Gemini in Chrome

The Magic Pointer on Googlebook was built with Google DeepMind. The research team behind this underlying capability shared more about the premise of AI-enabled pointers. DeepMind wants to use AI "to help the pointer not only understand what it's pointing at, but also why it matters to the user." Our goal is to address a common frustration: because a typical AI tool lives in its own window, users need to drag their world into it. We want the opposite: intuitive AI that meets users across all the tools they use, without interrupting their flow. For example, imagine pointing to an image of a building, and requesting "Show me directions". Nothing more is needed when the AI system already understands the context. The idea is to replace "text-heavy prompts with simpler, more intuitive interactions." An AI-enabled pointer would streamline this process by smoothly capturing the visual and semantic context around the pointer, letting the computer "see" and understand what's important to the user. Similarly, an "AI system that understands this combination of context, pointing and speech would allow users to make complex requests in natural shorthand." Example use cases include: In the example below, a "paused frame in a travel video becomes a booking link for that cool-looking restaurant." Google has two AI-enabled pointer demos in AI Studio: Additionally, you will soon have the ability to "use your pointer to ask Gemini in Chrome about the part of the webpage you care about." This is in the process of rolling out.

Shaping the future of AI interaction by reimagining the mouse pointer

We are developing more seamless, intuitive ways to collaborate with AI The mouse pointer has been a constant companion on computer screens, across every website, document and workflow. Despite how technologies have changed, the pointer has barely evolved in more than half a century. We've been exploring new AI-powered capabilities to help the pointer not only understand what it's pointing at, but also why it matters to the user. Our goal is to address a common frustration: because a typical AI tool lives in its own window, users need to drag their world into it. We want the opposite: intuitive AI that meets users across all the tools they use, without interrupting their flow. For example, imagine pointing to an image of a building, and requesting "Show me directions". Nothing more is needed when the AI system already understands the context. Today, we're outlining the underlying principles guiding our thinking on future user interfaces, and sharing experimental demos of an AI-enabled pointer, powered by Gemini. For example, you could visit Google AI Studio to edit an image or find places on the map, just by pointing and speaking.

Google is redefining the cursor for computers, and it's AI-charged future looks ridiculous

Google's Magic Pointer could be the next evolution of AI on laptops The humble mouse pointer has barely changed in decades. It moves, clicks, selects, drags, and occasionally turns into a spinning wheel of frustration. Google now wants to turn that tiny arrow into one of the most powerful AI tools on your laptop, which sounds ridiculous until you think about how often you use it. The company has announced Magic Pointer for Googlebook, its new category of Gemini-powered laptops. The feature gives the cursor AI abilities, allowing it to understand what you are pointing at and help you act on it without needing a long prompt or a separate chatbot window. Can the cursor become the new AI button? In a new DeepMind post, the company explained how it is rethinking the pointer for the AI era. The idea is to make Gemini understand the exact part of a webpage, image, table, document, or video frame the user is referring to. That turns the cursor from a basic navigation tool into a kind of AI remote control for the entire screen. This is where the whole thing starts to sound wonderfully absurd. A pointer could turn a table into a chart, compare products you select on a webpage, summarize a PDF into bullets for an email, or identify a building in a photo and pull up directions. The cursor, once used mainly to click tiny buttons, is suddenly being asked to understand context, intent, and action. Why does this matter for Googlebooks? Google has taken inspiration from the way people already communicate offline. You usually do not describe every object in a room before asking someone to move it. You point and say, "move this" or "fix that." Magic Pointer brings that same idea to the screen. The cursor tells Gemini what you are referring to, while short commands such as "add this," "merge those," or "what does this mean?" tell it what action to take. This new feature will be deeply integrated into Googlebook laptops, as Magic Pointer is being announced as part of that platform. That means Googlebook users should be able to use it more freely across the laptop experience, instead of being limited to a single app or browser window. Recommended Videos For everyone else, this AI pointer will be limited to Gemini in Chrome for now. Google says users can point to specific parts of a webpage and ask questions, such as comparing multiple selected products, summarizing technical specs from a product listing, or instantly converting prices into a different currency. If Magic Pointer works well, everyday AI tasks may no longer need a prompt box at all.