Google Enhances AI Mode with New Features for Search and Learning

Google's AI Mode gets new 'Canvas' feature, real-time help with Search Live, and more | TechCrunch

Google announced on Tuesday that it's adding new capabilities to AI Mode, its experimental feature that allows users to ask complex questions and follow-ups to dig deeper on a topic directly within Search. One of the new features, Canvas, helps you build study plans and organize information over multiple sessions in a side panel. For example, if you want to create a study plan for an upcoming test, you can click the new "Create Canvas" button to get started. From there, AI Mode will start putting things together in the Canvas side panel, and you can keep refining the output with follow-up prompts until it fits what you're looking for. Soon, you will also be able to upload files like class notes or a syllabus to customize your study guide. Users enrolled in the AI Mode Labs experiment in the U.S. will see Canvas in the coming weeks. Google is also bringing Project Astra capabilities directly into AI Mode via Search Live, which is integrated with Google Lens, the tech giant's visual search tool. "When you go Live with Search, it's like having an expert on speed dial who can see what you see and talk through tricky concepts in real-time, all with easy access to helpful links on the web," wrote Robby Stein, VP of Product, Google Search, in a press release. To use the feature, open Lens in the Google app, tap the Live icon, and ask a question while pointing the camera at something. With this feature, users can have a back-and-forth conversation with Search in AI Mode using visual context from their camera feed. Search Live with video input is rolling out this week on mobile in the U.S. for users enrolled in the AI Mode Labs experiment. In addition, Google announced that users will soon be able to use Lens in AI Mode to ask about what's on their desktop screen. "Perhaps you're looking at a geometry problem and want to better understand one of the diagrams," Stein said. "Click on 'Ask Google about this page' from the address bar and select the diagram. You'll get an AI Overview with a snapshot of key information directly in the side panel. And this week, you'll be able to follow up with more questions through AI Mode, by selecting AI Mode at the top of the Lens search results or by clicking the "Dive deeper" button at the bottom of the AI Overview." Plus, while you can already use AI Mode in the Google app to ask questions about images, you can now do so on desktop as well. Google is also adding support for PDF uploads on desktop, letting you ask detailed questions about documents. For example, you can upload PDF slides from a school lecture and ask follow-up questions to deepen your understanding beyond the class materials. Google says AI Mode will support additional file types beyond PDFs and images later this year, including Google Drive files.

Google's AI Mode update adds even more tools for students

Other changes coming soon include a test of real-time camera sharing in AI Mode, building upon the Search Live features it already has. Now, instead of just having a spoken conversation with AI Mode's custom version of Gemini, users can point their camera at whatever they have a question about and ask about it aloud. This feature is coming to mobile users in the US who have opted into the AI Mode Labs experiment. In addition, Google is trying to make it easier to access Lens in Chrome by displaying a new "Ask Google about this page" option when users click on the address bar in Chrome. When users select this option, the tool will generate an AI Overview of the webpage's content directly in the browser's sidebar. Google also plans on letting users ask additional questions about a Lens response by choosing "AI Mode" at the top of Lens results and selecting "Dive deeper."

Google upgrades AI Mode with Canvas and 3 other new features - how to try them

Love it or hate it, Google's AI Mode has revamped the way you search for information. Instead of presenting you with tens of thousands of website links, Google serves up an AI-generated overview and summary of the results. Also: Sick of AI in your search results? Try these 7 Google alternatives with old-school, AI-free charm That can save you time and labor by cutting to the chase. But it can also steer you away from the publishers and websites that do the actual work and potentially provide inaccurate information as AI is prone to do. Clearly seeing AI-powered search as the future, Google is enhancing its AI Mode with four new features. Covering a range of tasks, the new options are designed to appeal to a variety of people, some of whom may not yet be sold on the concept. First up, you'll be able to ask questions about uploaded images. Initially available just in the Google app for Android and iOS, this capability is now rolling out on the Google search page in desktop browsers. Also: Google's new Search mode puts classic results back on top - how to access it To give this a whirl when it's live, switch to AI Mode on Google's search engine. Click the button to upload an image and pose your question. In response, Google's AI will analyze the image, check any relevant information online, and then hopefully answer your query. The AI will also serve up links to websites used for the research. But the new feature won't be limited to images. In the coming weeks, Google also will support PDF file uploads. And in the coming months, the company promises to add other types of files, including those from your Google Drive storage. Canvas is a cool Google feature that offers an interactive workspace in which you can create code, design web pages, and devise other content, with the results appearing side by side in real time. With the latest update, Canvas will work in AI Mode to help you dynamically build information for a project or study plan. To create a plan, launch AI Mode and then select the button for Create Canvas. Google's AI will start to put together the necessary information, which you can then modify based on your needs and goals. Soon, you'll also be able to upload notes and other files to customize your plan. Also: Your Google Search experience will never be the same, thanks to 8 new AI features Not yet available, Canvas in AI Mode will roll out in the coming weeks to Google users who signed up for the AI Mode Labs experiment in the US. When the feature is ready, you'll see an option called Create Canvas that pops up when you ask for help creating or planning something. Google Lens gives the AI a peek at what you see or capture through your phone's camera. Search Live lets you chat with the AI to explore your search results. Now, Google is combining the two with a live camera feed. With this enhancement, you'll be able to ask the AI for help with searches on whatever appears through the camera. Also: 4 ways Google Lens on Chrome magnifies my productivity - and how to use it To try this out, open the Google Lens app, point your phone's camera at an item that interests you, tap the Live icon, and then ask any questions you have about the search results. The AI will respond, triggering a back-and-forth conversation to explore whatever is in front of you. This new capability is rolling out this week for people in the US who have signed up for the AI Mode Labs experiment. Using Google Lens in Chrome and AI Mode together, you can ask the AI questions about any website, file, or other item you see on your screen. Currently, you need to select Google Lens from the Chrome menu. But coming soon, a new update will let you more easily click the Chrome address bar and select an option to "Ask Google about this page." Also: NotebookLM's latest trick turns your notes into AI video slideshows - here's how In response, you'll see an AI Overview with key details in the side panel. Plus, you'll be able to ask follow-up questions just by selecting AI Mode at the top of the search results or clicking the Dive deeper button at the bottom of the overview. How do you feel about AI Mode in Search? And will the new features sway your opinion one way or the other?

Google is bringing image and PDF uploads to AI Mode

Google is updating AI Mode on desktop this week with the ability to process images, so you can ask it detailed questions about the pictures like you already can on mobile. In the coming weeks, the company is also adding support for PDF uploads on desktop in the US, which could help you digest lengthy course or work materials. You can ask AI Mode to summarize the documents for you and ask follow-up questions that it will then answer by cross-referencing the materials you uploaded with information available on the web. Google says AI Mode's responses will also include links to its references that you can visit in order to dig deeper. AI Mode will support additional file types for upload, including ones straight from your Google Drive, in the coming months as well. In addition to PDF upload support, Google is also rolling out a new Canvas feature that you can access if you're enrolled in the AI Mode Labs experiment in the US. You can use Canvas to consolidate all relevant information about a specific topic or for a specific purpose in a side panel that updates as you ask AI Mode more follow-up questions. If you're traveling, for instance, you can ask AI Mode to make you an itinerary and click the Create Canvas button. You'll be able to keep refining the itinerary with more questions, and you can always leave it alone for a while and come back to it later. AI Mode's Search Live is also getting video input on mobile this week, a feature Google announced at I/O 2025, after voice input arrived in June. To be able to access video input, you'll have to open Lens in the Google app and tap the Live icon before asking questions on what the camera sees. When Google revealed the feature during its annual developers' event, it said you could point the camera at a math problem, for example, and ask Search to help you solve it or to explain a concept you're having trouble understanding. Finally, with Lens in Chrome, you'll be able to ask AI Mode what's on your desktop screen. The company will roll out an "Ask Google about this page" dropdown option in the address bar "soon." When you click on it, AI Mode will create an overview with key information on what's being shown on your screen, whether it's a web page or a PDF.

Google Search is becoming smarter with these AI Mode improvements

On desktop, AI Mode gets file support and a Canvas option for taking notes while researching. Google's AI Mode is gradually expanding beyond Search and recently made its way to other apps used to look up information on your phone, including Google Lens and Circle to Search. In doing so, it is also bridging the gap between Gemini and AI Mode by adding similar features to search experiences. And today, Google is officially expanding on AI Mode's capabilities, bringing features to improve output and enable collaboration.

Google Search is going back to school with these powerful AI Mode additions

Just in time for back-to-school season, Google is rolling out a set of new Gemini AI Mode features in Search designed to make studying, research, and project planning easier. The updates, announced today by Robby Stein, VP of Product for Google Search, expand AI Mode into new territory: handling course materials, helping students stay organized, and even explaining diagrams in real time through live video input. I supercharged Google search with a three-key shortcut with custom results Find out the advanced trick I use to speed up web searches and get better results on Chromebooks and in Google Chrome for desktop Posts High-utility AI Mode tools hitting the web interface Upload images and PDFs on desktop Until now, asking detailed questions about images in AI Mode was limited to Google's mobile apps. That changes this week, as desktop users in the U.S. can now upload images -- and soon, PDFs -- directly into Search. Google says the feature is aimed squarely at students. You could, for example, drop in a psychology lecture PDF or a page from your chemistry textbook and then ask AI Mode follow-up questions that go beyond the basic content. The system will cross-reference the file's contents with relevant information from the web, offering an AI-generated explanation alongside prominent links for deeper research. Support for other file types, including documents from Google Drive, is planned for later this year. Canvas: an interactive planning panel Another addition is Canvas, a new mode that lives in a dynamic side panel. Instead of spitting out a one-off AI response, Canvas lets you build and refine a plan across multiple sessions. Say you're building a study plan for finals: you can create a Canvas, ask Gemini to generate an outline, then refine it step by step. The panel updates in real time, and you'll soon be able to upload your own notes or syllabi to customize the plan even further. Google is pitching Canvas as useful beyond education -- for trip planning, major projects, or anything that benefits from structured, iterative planning. Canvas is rolling out in the coming weeks for U.S. users enrolled in the AI Mode Labs experiment. Search Live with video input Google is also bringing in some of the tech it previewed earlier this year under "Project Astra." Search Live lets you point your phone's camera at a problem -- say, a tricky geometry diagram or a confusing formula -- and have a back-and-forth conversation with AI Mode about what you're seeing. The system isn't static; it can handle moving objects and multiple angles, and it ties directly into Google Lens. The feature starts rolling out this week on mobile in the U.S., again limited to AI Mode Labs testers. Lens in Chrome gets smarter Finally, Google is upgrading Lens in Chrome with AI Mode follow-ups. Lens has long been able to identify what's on your screen, but now you can go deeper by clicking "AI Mode" at the top of the Lens results or tapping a new "Dive deeper" button in the AI Overview. So if you're staring at a diagram in an online PDF, you can ask Lens for an overview, then immediately start an AI conversation to better understand what's in front of you. The big picture for interactive research and study Extracting real-world usefulness from the hype Together, these features push AI Mode beyond being a novelty Q&A tool into something more like a study partner and productivity hub. The ability to upload course materials, build interactive study plans, and get live explanations in context could make Search a lot stickier for students heading into the school year. Of course, most of these updates are limited to the U.S. and to users in Google's AI Mode Labs program -- so not everyone will see them right away. But the direction is clear: Google wants AI Mode to become the go-to tool not just for finding information, but for making sense of it. 11:28 Can Google Search's cash cow live on in Gemini? [Video] Or will OpenAI and Perplexity eat that lunch?

Google AI Mode adding Search Live video, Canvas, PDF upload, and more

After adding Gemini 2.5 Pro, Google is updating AI Mode with four big features across Search Live (video with Google Lens access), Canvas, and more. In addition to text, you will soon be able to upload images and PDF files to AI Mode on the web. The former is already available on mobile, while the latter will let you "ask detailed questions about those documents and bring that context into your search." Uploaded files will be analyzed and cross-referenced with "relevant information from the web." This is rolling out to stable in the coming weeks, with support for more file types (including Google Drive) coming in the future. Like the Gemini app, AI Mode is getting a Canvas feature that lets you "build plans and organize information over multiple sessions in a dynamic side panel that updates as you go." For example, if you want to create a study plan for an upcoming test, just ask AI Mode, then tap on the "Create Canvas" button to get started. Google is positioning Canvas in AI Mode as helping you build study guides or plan trips, with the ability to ask follow-up questions and make edits by highlighting a portion of the generated text. Soon, the new upload feature will also make it possible to customize your study guide (or whatever you need to create) with context from your files, like class notes or a course syllabus. This will be available in the coming weeks on desktop web in the US for those enrolled in the AI Mode Labs experiment. Another Search Labs feature is video input in Search Live. After launching voice last month, Google will let you show AI Mode what you're seeing in the real world. You can launch it from the latest Google Lens redesign with a new "Live" tab alongside "Search" and "Translate." Google is rolling out Search Live with video this week to testers in the US on Android and iOS. Finally, AI Mode is coming to Google Lens in desktop Chrome. Clicking the Chrome address bar will show an "Ask Google about this page" chip. This lets you select a part of the page, with the usual AI Overview appearing in a side panel. A "Dive deeper" AI Mode button will soon appear at the bottom.

Google Search just got a major upgrade -- you can now ask images, PDFs and more with AI Mode

Google is rolling out a new wave of AI features to Search just in time for the back-to-school season. The updates expand what users can do in AI Mode, Google's experimental interface that blends generative AI with traditional search. The latest features include support for asking questions about PDFs and images, a new planning workspace called Canvas and real-time help with video input through Search Live. While many of these tools are still in preview through Google's AI Labs, they show how the company is layering more interactivity into everyday search experiences. Now users can ask about PDFs, images and soon, their own files. Arguably one of the most useful upgrades is the ability to ask questions about uploaded PDFs, a feature rolling out to desktop over the next few weeks. This builds on existing image-based search in AI Mode, which is already available in the Google app on Android and iOS and is now expanding to desktop browsers as well. For example, students can upload lecture slides or scanned handouts, then ask detailed questions about the content. AI Mode cross-references the file with web sources to generate a summary or explanation, complete with links to dig deeper. Support for additional file types, including documents stored in Google Drive, is expected in the months ahead. Google is also launching Canvas, a side panel that helps you organize plans or content from your AI searches. For example, a student could ask AI Mode to help create a study guide for an upcoming test. Now, users will see an option to "Create Canvas," which opens a dynamic space where your outline or plan begins to take shape. Canvas is designed to be flexible, meaning, you can refine it over multiple sessions, ask follow-up questions and soon even upload your own files (like class notes or a syllabus) to tailor the results. Of course, this feature is for users that aren't students, too. It can be useful to build travel itineraries, compare shopping lists or brainstorm creative projects. Canvas is rolling out first to users enrolled in Google's AI Mode Labs experiment in the U.S., and will appear in desktop browsers. Another new feature, Search Live, brings a real-time, video-enhanced layer to Search. Using your phone camera and Google Lens, you can point at an object or diagram and start a conversation with AI Mode, asking questions as you move your camera or change the angle. The tool, powered in part by Google's Project Astra, is designed to feel like having an expert explain something as you look at it. Search Live is rolling out now on mobile to AI Labs users in the U.S.; it integrates directly with the existing Lens tool in the Google app. Finally, Google is adding tighter integration between AI Mode and Chrome. Starting soon, when you click the Chrome address bar, you'll see a new "Ask Google about this page" option. This lets you use AI Mode to get an overview of what you're reading, such as an explanation of a diagram in a math problem, or follow up with deeper questions using the "Dive deeper" button. The feature builds on Lens in Chrome, and the AI summary appears in the side panel, helping users better understand complex topics without leaving the page. If you're in the U.S. and enrolled in Google's Search Labs, you can activate AI Mode by selecting the new button on the Google homepage (on desktop) or through the Google app (on mobile). Many of these features like Canvas and Search Live, will appear gradually over the coming weeks. Google says more file types, better customization, and smarter follow-up interactions are planned in the months ahead. For students, professionals and casual users alike, there's no doubt that AI Mode is becoming a more capable and more personalized tool for learning and exploration.

Google's upgraded AI Mode is set to transform search - again

AI Mode can now analyze PDFs and images, and use Search Live to analyze video content Google has enhanced its AI Mode in Search with a host of new features clearly aimed at encouraging people tempted by AI tools elsewhere to stick around. AI Mode is already different from traditional search in that it sets up a more comprehensive response to your query by sending out multiple related questions based on your initial prompt. You can then ask follow-ups and adjust the thrust of your search. With the new updates, AI mode is more of a multifaceted tool for learning and organizing information. The most immediately noticeable upgrade is that you can now upload PDFs and images to AI Mode on your desktop and ask nuanced questions about them. On mobile, Google already lets you use AI Mode to ask questions about photos or screenshots. But making it available to desktop users means you can upload entire slide decks from a class or drag over a PDF of a book and grill the AI about the content like it's an unpaid tutor. And the model doesn't just respond based on your file; it will cross-reference the web to give answers that fit the context of your upload and are backed by sources and links. In case you can't get all your deep dives done in one search, the new Canvas feature offers AI Mode users a more long-term option for organizing information. Canvas appears as a side panel in AI Mode that lets you create and edit projects across multiple sessions. It's not dissimilar to the Canvas feature for ChatGPT, or indeed the Gemini Canvas tool it's clearly based on. Think of it like a cross between a collaborative document and a study planner. You can start with a prompt about a long-term project for learning something, then hit the Create Canvas button and see the AI piece together a draft, organize resources, and respond to follow-up questions as you tweak or elaborate on your goals. Plus, you can keep returning to it even if you close the tab. Continuity is crucial if you want to do more than just a traditional Google search that ends when you close the window. Google has plans for Canvas to support its own file uploads, too, so it will absorb some of the abilities of AI Mode's general toolkit. In fact, it seems like AI Mode will eventually look a lot like NotebookLM, though, for now, not with any AI-built podcasts. The third and possibly most futuristic upgrade to AI Mode is Search Live. If Canvas is about long-term thinking, Search Live is for real-time responses. Search Live embeds Google Lens with Google's Project Astra AI to provide answers based on the video you show it. Using Search Live, you could point your phone's camera at any problem from a math equation on a page to a misbehaving appliance and start asking the AI questions while you're filming. The camera feed becomes the context for the AI's answers as it uses what you're seeing and saying to respond with solutions, and links as though you're FaceTiming a friend with all the answers. This kind of live help could make people rethink what they expect from AI tools in terms of both accuracy and immediacy. Instead of a blank search box, it's looking at something, conversing about it, and delivering useful answers immediately. That trend continues with the Google Lens upgrades coming to Chrome. Google is changing the address bar so that when you click on it, you'll be offered the option to "Ask Google about this page" and get answers about whatever website, PDF, slide, or other content is open in Chrome. You'll even be able to get AI Overviews of any section you highlight. You can then tap into AI Mode to go deeper, essentially using the web page as a starting point for a more in-depth project. All of these changes may not feel like overnight revolutions, but they could be the basis for a new way of thinking about search. And as AI chatbots encroach on what was once Google's undisputed leadership in looking for things online, the company is no doubt hunting for competitive answers and, in the process, delivering AI search upgrades like these upgrades to us.

Google's AI Mode is quietly turning search into a productivity tool

Google's AI Mode is brining new features in an attempt to reshape how people interact with the web. Google Search has been one of the primary gateways to information on the internet, but it's about to evolving into something more. With the latest set of features being added to AI Mode, Search will no longer be just a tool for finding links or information, but an assistant that can help you organize, understand, and act on that information. Instead of just answering questions, AI Mode is being transformed into what seems to be a helpful workspace. It will soon support you through complex documents, explain visuals, and even help with multi-step tasks. With the addition of these new tools, Google is slowly changing how search works by helping you do more than just find information. What's new in AI Mode A handful of new capabilities are being introduced that expand what AI Mode can do particularly on desktop browsers, where users often juggle multiple tabs, files, and formats during more complex workflows. PDF and image uploads for context-aware queries AI Mode on desktop will now support uploading PDFs and images which will allow users to ask questions about the content in those files and receive web-informed, AI-generated responses. Recommended Videos Imagine having a research report or technical manual in front of you. Instead of searching for terms manually, you can now upload the file, highlight a section, and ask, "Can you explain this further?" The AI will analyze the document and return contextually relevant explanations, along with links for deeper reading. Support for additional file types, including those from Google Drive, is expected in future updates expanding this capability to more kinds of content. Canvas for task planning and organization Another interesting addition is Canvas, that allows users to create and refine plans in a persistent, editable side panel. It's a tool designed for tasks that span multiple sessions like project planning, research outlines, trip itineraries, and more. The system will let you iterate in real time, ask AI Mode to draft a plan, make changes through follow-up prompts, and organize the results visually in the side panel. Users will also be able to upload their own files, like meeting notes, to help personalize the output. Canvas essentially helps you stay organized and make progress across sessions, documents, and devices. Search Live: AI conversations with visual input Perhaps the most technically ambitious update is Search Live, which integrates Google's camera-based Lens tool with AI Mode to deliver real-time, conversational help based on what your camera sees. Whether it's a diagram, a schematic, or a physical object, you can point your phone's camera at it and start a conversation. The AI interprets the visual data, offers insights, and even lets you refine questions, creating a kind of live tutoring or troubleshooting session, powered by AI and the web. This feature is based on Google's Project Astra work, and is being rolled out on mobile in the U.S. for users enrolled in the Labs experiment. AI Mode in Chrome: Smarter browsing, fewer tabs For desktop users, AI Mode is getting more closely integrated into Chrome. Soon, you will be able to click "Ask Google about this page" from the address bar, which will launch Lens and the AI assistant to help you understand whatever is on your screen, whether it is a complex chart, a technical section, or a difficult diagram. You can even ask follow-up questions directly in the side panel, making it easier to explore a topic without switching tabs or starting a new search. This could change how people interact with web content and with Google itself. A more useful, less interruptive AI? There's no shortage of AI tools that come with a promise to boost productivity. But where many require a full switch of platforms or behavior, AI Mode is being embedded into existing habits including Search, Chrome, and Lens. Rather than pitching itself as a digital co-pilot or assistant with a personality, Google is trying to make AI Mode feel more like a context-aware layer for everyday digital tasks. Upload a file, ask a question, build a plan, check in later, all within the browser or the search bar. Google says that it is gradually rolling out these features to AI Mode, with some already available in early access for users who have joined the AI Mode Labs program.

New ways to learn and explore with AI Mode in Search

We're introducing new features and capabilities for AI Mode in Search, just in time for the back-to-school season. Whether you're a student, a parent or an educator -- or just wrapping up a busy summer -- AI Mode can help you explore complex questions and discover high-quality information from across the web. To get started today on desktop, look for the new AI Mode button on the Google homepage. You can already use AI Mode in the Google app on Android and iOS to ask complex questions about images, and this week the same capability is launching on desktop browsers. Plus, in the coming weeks, we're adding support for PDF uploads on desktop, so you can ask detailed questions about those documents and bring that context into your search. For example, you could upload PDF slides from your psychology lecture and ask follow-up questions to deepen your understanding beyond the primary course materials.

AI Mode Soon Getting Much Needed Feature

We may earn a commission when you click links to retailers and purchase goods. More info. Google is introducing improvements to AI Mode, as well as teasing future features. It's actually kind of rude, but it's fine I guess. Google announced this morning that AI Mode is getting PDF support on desktop computers, allowing users to deep dive on subjects. Similar to its NotebookLM resource, you can upload all sorts of text, such as curriculum, then have AI Mode analyze the contents of your file and cross-reference it with relevant information from the web. The idea is to allow the user to gain a broader understanding of essentially any subject with the help of AI. An exciting tidbit is that AI Mode will soon support additional file types beyond PDFs and images, including files from your Google Drive. This is great news with regard to how Google is integrating all of these AI services into its product portfolio. Introducing Canvas in AI Mode: Google is also introducing Canvas, a mode that helps you build plans and organize information over multiple sessions in a "dynamic side panel" that updates as you go. As Google explains, "If you want to create a study plan for an upcoming test, just ask AI Mode, then tap on the "Create Canvas" button to get started. Right away, AI Mode will start piecing everything together in the Canvas side panel, and you can use follow-ups to refine the output until it meets your exact requirements." Search Live News: To round it all out and rolling out this week, Search Live with video input will allow users to have real-time conversations with AI Mode using their camera feed, providing visual context and access to web links. You can access this via Google Lens and you'll need to be enrolled in AI Mode Labs experiment.

Google rolls out new ways to use AI Mode search with PDFs, images, live video and more - SiliconANGLE

Google rolls out new ways to use AI Mode search with PDFs, images, live video and more Google LLC today announced an upgrade to its conversational artificial intelligence search tool, AI Mode in Search, expanding its capabilities. The company introduced AI Mode in March, which lets users transform the familiar Google Search experience from simple lists of links into dynamic, personalized explanations and cohesive paragraphs, while also enabling them to ask direct questions about web content. With the new update, Google is adding four big features across Search Live (video with Google Lens access), Canvas, image and PDF uploads and more. Users can already ask AI Mode on mobile devices in the Google app about images; this week, the same capability is launching for desktop browsers. The company said that in the coming weeks, the same capability will roll out to support PDF uploads. This allows users to ask complex questions about lengthy PDF documents, including legal files, extensive financial data, or slides from academic lectures. Users can then use the AI chatbot to ask follow-up questions to deepen their understanding of the content beyond the base material and it will cross-reference the vast information on the web to provide helpful AI responses, along with citations to allow users to dig deeper. Google said in the months ahead, the company intends to add further support in AI Mode for other file types beyond PDFs and images, including files in Google Drive. Canvas provides a way for users to build projects and plans over multiple sessions in a dynamic side panel that updates as they progress. For example, if a user is searching for information on the web to create a study guide or is building a project, AI mode will ask if they want to make a Canvas. If the user clicks the button, the chatbot will immediately start building a Canvas side panel with information from searches and will use the conversation to refine the information and formatting. "No matter what you're working on, from test prep to travel planning, you can always come back to your Canvas project and pick up where you left off," said Robby Stein, vice president of product at Google Search. Canvas will become available for users in the United States over the coming weeks who are enrolled in AI Mode Labs experiments. This week, Google is launching Search Live with video input, which will bring advanced capabilities from the company's Project Astra directly into AI Mode. Project Astra is the company's work on building a real-time multimodal assistant that can both see and speak to the user. Users can launch it from within Google Lens with the new "Live" tab alongside "Search" and "Translate." Once running, AI Mode will be able to view what the mobile camera can see and respond verbally to questions about what's happening. "When you go Live with Search, it's like having an expert on speed dial who can see what you see and talk through tricky concepts in real-time, all with easy access to helpful links on the web," said Stein. The new feature will become available to iOS and Android users in the U.S. for users enrolled in Mobile Labs experiments. Google Lens enables users to search the internet using images or the camera on their mobile devices. Now, with its integration into Google Chrome on desktop computers, users can inquire and learn more about what they see on their screens -- whether it's a website, a PDF, or any other content they're viewing. This feature already exists for Windows 11 users with Copilot Vision, Microsoft Corp.'s AI chatbot that lives in the operating system, which can see the desktop and answer questions about it when summoned. Beginning soon, when users click on Chrome's address bar, they'll see a new option to "Ask Google about this page" in the dropdown suggestions, which will allow them to access Lens in Chrome. This will pop up a sidebar with an AI Overview of selected images or the desktop. This week, that capability is being expanded with AI Mode, allowing users to dive deeper, follow up with questions and receive expert information about what they're seeing.

AI Mode Gets Search Live With Video and PDF Support Features

Google is adding several new features to AI Mode in Search, the company's latest artificial intelligence (AI)-powered search experience. On Tuesday, the Mountain View-based tech giant announced four new features to expand the usability of the tool. The most prominent inclusion is the expansion of Search Live, which will allow users to ask questions from the video feed in Google Lens. Apart from this, a new Canvas mode and support for PDF files are also being added to the AI Mode. In a blog post, the tech giant detailed the new features coming to AI Mode. Some of these features will arrive over the next week, while others might take a bit longer to be released. While the company did not specify, it is expected that these features will first be available in the US. Interestingly, all of these features are already available via Gemini. Last month, Google introduced Search Live for AI Mode. It allows users to have back-and-forth voice conversations with the chatbot in real-time, similar to Gemini Live. Now, the company is adding video support to the feature. This capability can be accessed via Google Lens, where Search Live is already integrated. Users can open Lens in the Google app, tap on the Live icon, and ask AI Mode any question about the object inside the frame. The chatbot can analyse the content from the video feed in real-time and answer user queries. Search Live with video will be released this week on mobile in the US for the users enrolled in the AI Mode Labs experiment. AI Mode already allows users to upload an image and ask queries about its content. In the coming week, the company is also adding support for PDF on desktop. Users will be able to upload a file, ask questions about its content, and the chatbot will be able to answer user queries and contextualise the information from the web. Google said that in the future, AI Mode will also support other file types besides PDFs and images, including files from Google Drive. Another new feature coming to AI Mode is Canvas. Similar to the version of the tool available in Gemini, the feature can be used to create plans and organise information. There is no dedicated button for the tool; instead, when users ask a query that fits the use case of Canvas, AI Mode will surface a "Create Canvas" button. Tapping it opens a dynamic side panel where the chatbot creates the requested plan. Once a Canvas has been created, users can refine it by asking follow-up queries, or even highlighting a particular portion of the text and requesting a change. Google says, soon users will also be able to customise the plans with context from files such as class notes or a course syllabus. This feature is coming to users enrolled in the AI Mode Labs experiment in the US on desktop in the coming weeks. Finally, the tech giant is also integrating AI Mode into Google Chrome via Lens. This feature will allow users to ask AI Mode about anything that's on the user's screen. It can be accessed by clicking on Chrome's address bar and selecting a new option dubbed "Ask Google about this page." This will open AI Mode in a side panel on the page, and the chatbot will be able to answer any queries the user might have. Users can also select any element or text on the page to let the chatbot gain context for the query.

Google AI Mode gets PDF uploads, Canvas planner, and Chrome AI tools

Google has rolled out new AI Mode features in Search aimed at improving learning and research, especially as students head back to school. These additions -- like PDF queries, live video interaction, and a Canvas planning tool -- are built to help users break down complex topics and manage study material with ease. Robby Stein, VP of Product at Google Search, says AI Mode is designed to help people "explore complex questions and discover high-quality information" across formats and platforms. Ask Questions About Images and PDFs AI Mode now supports querying images on desktop browsers, complementing existing mobile app functionality. Soon, users will be able to upload PDF documents on desktop to ask specific questions related to the document's content. For instance, uploading lecture slides allows the AI to analyze the material and offer responses that combine the document context with related web information. He also noted that support for additional file types and Google Drive integration is planned. Create Study Plans with Canvas Canvas is a new AI Mode feature that helps users organize information and build plans through a dynamic side panel. By requesting assistance, such as creating a study plan, users can activate Canvas, which compiles relevant data and refines the plan through follow-up queries. The feature will also allow uploads of files such as class notes or syllabi to customize outputs. Canvas saves progress across sessions, allowing users to return to their projects as needed. Get Real-Time Help with Search Live Search Live integrates video input into AI Mode, enabling real-time interaction with the AI through a live camera feed. Using Google Lens in the Google app, users can point their camera at objects or text and ask questions that the AI answers instantly, supported by relevant links. This feature leverages technology from Project Astra and is designed to provide expert-level assistance on demand. A new Lens integration within Chrome allows users to select "Ask Google about this page" from the address bar dropdown while browsing. This enables highlighting of page elements -- such as images or diagrams -- and receiving an AI-generated overview in a side panel. Users can further engage with AI Mode to explore topics in greater detail, facilitating contextual learning directly from browser content.

Google's AI Mode can now read PDFs, gets Canvas feature and more

AI Mode is now just a click away on desktop, accessible via a new button on the Google homepage. Google is rolling out a bunch of new features to its AI Mode in Search to make it more useful for students, educators, and everyday users. The latest update brings new capabilities for handling images, PDFs, planning tools, and real-time video input, for a more interactive and intuitive search experience. Starting this week, users on desktop can access AI Mode directly from the Google homepage via a new button. The AI mode on the web will now let users ask complex questions about images on desktop browsers, a feature already available on mobile. In the coming weeks, PDF support will also be added, allowing users to upload documents such as class notes or lecture slides and ask questions directly within Search. The system will analyse the file, cross-reference information from the web, and return detailed AI-generated responses along with relevant source links. Google is also introducing Canvas to help users plan and organise tasks across multiple sessions. Canvas can be used to create study guides, project outlines, or other structured content. After requesting a plan in AI Mode, users can click "Create Canvas" to begin building in a side panel that evolves with follow-up input. Soon, users will also be able to upload files like syllabi or notes to customise their Canvas workspace further. The feature will roll out first to US-based users enrolled in the AI Mode Labs experiment on desktop. Further, the Search Live brings real-time video input to AI Mode through the Google app. Integrated with Google Lens and powered by Project Astra, this will allow users to point their camera at an object, ask questions, and receive AI-generated responses based on live visual context. Also read: Qualcomm's first Snapdragon Auto Day lays out India-centric roadmap for smarter & safer vehicles Not only this, but users will soon see an option in Chrome's address bar to "Ask Google about this page," integrating AI Mode and Lens directly into desktop browsing for quick context about PDFs, websites, or on-screen content.