Google's AI Mode Search Evolves: Now Answering Questions About Images
23 Sources
[1]
Google's AI Mode search can now answer questions about images
Google started cramming AI features into search in 2024, but last month marked an escalation. With the release of AI Mode, Google previewed a future in which searching the web does not return a list of 10 blue links. Google says it's getting positive feedback on AI Mode from users, so it's forging
[2]
Google's AI Mode now lets users ask complex questions about images | TechCrunch
Google is bringing multimodal search to AI Mode, its Google Search experiment that lets users ask complex, multi-part questions and follow-ups to dig deeper on a topic. Users who have access to AI Mode can now tap the feature to ask questions about photos they've uploaded or taken with their
[3]
Google's AI Mode can now see and search with images
Jess Weatherbed is a news writer focused on creative industries, computing, and internet culture. Jess started her career at TechRadar, covering news and hardware reviews. Google is adding multimodal capabilities to its search-centric AI Mode chatbot that enable it to "see" and answer questions
[4]
Google Search's AI mode goes multimodal
Google's take on an AI search engine just got much better, and it's still free. Google has dominated the search engine market for decades. However, the rise of generative AI has presented a new form of competition -- AI search engines. With its AI Mode, Google provides users with exactly that: an
[5]
Google Search just got an AI upgrade that you might actually find useful - and it's free
Google's take on an AI search engine just got a multimodal improvement, allowing you to pull results of what you see. Google has dominated the search engine market for decades. However, the rise of generative AI has presented a new form of competition -- AI search engines. With its AI Mode, Google
[6]
Google Expands Its Conversational 'AI Mode' Search Option
AI Mode is Google's attempt to compete with other AI chatbots that have added web-search capabilities. It's also a step beyond the AI Overview search results that Google introduced last May (and which promptly began serving up wildly inaccurate results sourced from places like sarcastic Reddit
[7]
Google AI Mode rolls out to more testers with new image search feature
Google is bringing AI Mode to more people in the US. The company announced on Monday it would make the new search tool, first launched at the start of last month, to millions of more Labs users across the country. For uninitiated, AI Mode is a new dedicated tab within Search. It's essentially
[8]
This new AI Mode feature is like Google Lens on steroids
You can now use AI Mode in Search to ask questions about images, as Google has upgraded the feature with the powerful multimodal capabilities in Lens. The company announced this change in a recent blog post, highlighting that AI Mode can now "understand the entire scene in an image, including the
[9]
AI Mode takes the spotlight in the Google app's latest revamp
The app is now experimenting with prominent AI Mode placement, right in that top bar. Google Search has changed a lot over the years, and while in the past that's involved a lot of subtle refinement to the sort of results a given query would generate, over the past year or so we've seen Google
[10]
Google's AI Mode gains popular camera search as rollout expands to more users
Summary Lens' multimodal capabilities are now integrated into Google's AI Mode, letting users interact with images and text seamlessly within conversations. AI Mode now delivers more "nuanced" and "contextually relevant" responses in the Google app on Android and iOS. Google is expanding AI Mode to
[11]
Google could move the AI Mode icon front and center
Gboard's AI meme generator aims to take over humanity's most sacred online contributions Summary Google is testing a new, more prominent placement for the AI Mode shortcut, moving it into the main search bar on Android by replacing the voice search and Google Lens icons. This change aims to make
[12]
Google AI Mode adding multimodal Google Lens search
AI Mode entered testing a month ago and Google is now expanding access to free Labs users, as well as adding Lens visual search. At launch, it was just available for Google One AI Premium subscribers. As we previously spotted, Google confirmed today that it's coming to "millions more Labs users in
[13]
Google tests new Search bar to access AI Mode on Android
As AI Mode testing continues, Google is trialing a new way to launch the generative experience from the Search bar on Android. Since launch, you've been able to start a new AI Mode chat from the shortcut underneath the Search bar at the top of the Google app. It lives alongside the buttons
[14]
Google just supercharged search with AI Mode and Lens integration -- what you need to know
In a significant step towards a more intuitive and visually driven search experience, Google is expanding access to its experimental AI Mode and equipping it with the power of Google Lens. These developments aim to provide users with a more comprehensive search experience, almost like a 'deep
[15]
Google's AI Mode can explain what you're seeing even if you can't
Google is adding a new dimension to its experimental AI Mode by connecting Google Lens's visual abilities with Gemini. AI Mode is a part of Google Search that can break down complex topics, compare options, and suggest follow-ups. Now, that search includes uploaded images and photos taken on your
[16]
Google's New AI Mode Will Answer 'Nuanced' Questions About Your Photos
Google's new AI mode can now answer complex questions about a user's photos. The new image-analyzing functionality is powered by Google Lens' multimodal capabilities, the company says. This new multimodal understanding in AI mode allows users to take a photo or upload one, and ask questions about
[17]
Bringing multimodal search to AI Mode
Since launching AI Mode to Google One AI Premium subscribers, we've heard incredibly positive feedback from early users about its clean design, fast response time and ability to understand complex and nuanced questions. On average, AI Mode queries are twice as long as traditional Search queries on
[18]
Google's AI Mode Just Got a Major Upgrade
We may earn a commission when you click links to retailers and purchase goods. More info. Google first introduced us to AI Mode in Google Search back in March as a way for heavy Search users to ask the "toughest" questions, continue with follow-ups, and see helpful web links in return. It was
[19]
AI Mode in Google Search gets new visual search capabilities - SiliconANGLE
AI Mode in Google Search gets new visual search capabilities Google LLC is updating the new "AI Mode" feature in Google Search, introducing multimodal capabilities that allow it to "see" images uploaded by users, so it can better answer their questions. AI Mode was introduced in a limited preview
[20]
Google AI Mode update brings powerful multimodal search - Phandroid
Google AI Mode update is getting serious. Early users already loved its clean look and fast responses, but now Google's pushing it even further. Starting today, millions more Labs users in the US are getting access. And with it, something big: full-blown multimodal search powered by Lens. With
[21]
Google Lens Will Now Show Multimodal AI Mode Search Results
Once activated, Google Lens searches will show AI Mode by default Google announced that it is expanding its recently released AI Mode feature to more apps and users on Monday. The feature is now available in Google Lens and comes with multimodal capability. The company also said that the free
[22]
AI Mode in Google Search is Rolling Out to Free Users
In addition, Google has added visual search to AI mode via Lens, which leverages Gemini 2.0's multimodal capability. Google launched a dedicated 'AI Mode' in Google Search last month, but it was only available to Google One AI Premium subscribers. Now, the search giant is expanding AI Mode in
[23]
Google rolls out AI Mode to more users with multimodal search
Google on Monday announced a broader rollout of its AI Mode to millions more Labs users in the U.S., following strong early feedback. The company also introduced multimodal search within AI Mode, expanding on the feature first launched last month. Robby Stein, VP of Product at Google Search,
Share
Copy Link
Google has upgraded its AI Mode search with multimodal capabilities, allowing users to ask complex questions about images. This feature combines Google Lens with a custom version of the Gemini AI model.
Google Enhances AI Mode with Multimodal Capabilities
Google has taken a significant leap forward in its AI-powered search capabilities by introducing multimodal functionality to its AI Mode search feature. This update allows users to ask complex questions about images, combining the power of Google Lens with a custom version of the Gemini large language model (LLM)
1
2
.How It Works
The new multimodal AI Mode enables users to upload images or take photos directly through the search interface. Google Lens identifies specific objects within the images, while the Gemini model interprets the overall content and context. This combination allows AI Mode to understand the entire scene, including how objects relate to each other, their materials, colors, shapes, and arrangements
3
.Google employs a "query fan-out" technique, where the system asks multiple sub-queries about both the image and the objects within it. This approach provides more detailed and contextually relevant information than traditional search methods
2
4
.User Experience and Functionality
Users can now engage in more complex interactions with AI Mode. For example, a user could take a photo of their bookshelf and ask, "If I enjoyed these, what are some similar books that are highly rated?" The system would then identify each book, provide recommendations, and even allow for follow-up questions to refine the search results
2
5
.Expansion of Access
Initially launched exclusively for Google One AI Premium subscribers, Google is now expanding access to AI Mode to "millions more Labs users in the US" who aren't paying for AI features
1
3
. This move suggests that Google is confident in the feature's performance and is preparing for a broader rollout.Related Stories
Implications for Search and Competition
Google's AI Mode represents a significant shift in how users interact with search engines. The company reports that early telemetry shows users inputting about twice as much text in their searches compared to traditional web search, indicating a more detailed and conversational approach
1
.This development positions Google to compete more effectively with emerging AI-powered search alternatives like Perplexity and OpenAI's ChatGPT Search
3
4
. By combining real-time web-based answers with a conversational AI interface, Google aims to offer both the accuracy of a search engine and the interactivity of a chatbot5
.Future Outlook
As Google continues to refine and expand AI Mode, it's clear that the company sees this as a key strategy to maintain its dominant position in the search market. The integration of multimodal capabilities and the expansion of access suggest that AI-powered, conversational search experiences may become the new norm for internet users in the near future
1
3
.References
Summarized by
Navi
[1]
[3]
Related Stories
Recent Highlights
1
AI Hallucination Nearly Sparked US Military Confrontation With Chinese Ship in Middle East
Technology
2
OpenAI AI Agent Hacks Australian Government Healthcare Website in First-of-Its-Kind Breach
Technology
3
AI leaders warn UN Security Council of existential risks to humanity, call for global safeguards
Policy and Regulation
Recent Highlights
Today's Top Stories
Don’t drown in AI news. We cut through the noise - filtering, ranking and summarizing the most important AI news, breakthroughs and research daily. Follow topics that matter to you and stay ahead.
