Apple Introduces Visual Intelligence: AI-Powered Visual Search for iPhone 16
3 Sources
3 Sources
[1]
Apple adds Visual Intelligence - its answer to Google Lens - to the iPhone 16 camera
The company upgraded the iPhone camera with AI-powered Visual Intelligence, giving users visual search straight from the camera app. Here's how it works. During Monday's iPhone 16 event, Apple announced a brand new lineup of iPhones, AirPods and AirPods Pro, AirPods Max, and an Apple Watch Series 10. Apple also took the opportunity to expand on some Apple Intelligence features, the artificial intelligence (AI) tools coming to the iPhone. This includes a new Visual Intelligence feature, which essentially gives the iPhone camera Google Lens capabilities. Apple's Visual Intelligence lets you capture a photo of things around you, like a flyer or a restaurant, and then uses iPhone's AI capability to search for it and give you more information. Also: Everything we expect at Apple's iPhone 16 event: AI features, AirPods, Apple Watch Series 10, more Apple says captured data will remain private when used with Apple Intelligence and the company's Private Cloud Compute, but users can opt for third-party integrations with the new camera experience. Third-party integrations include the ability to search Google for whatever the camera captures, much like opening Google Lens straight from the iPhone camera app. Users can also allow ChatGPT integration with the Visual Intelligence feature, which would allow the AI chatbot to process the image data captured by the camera. These third-party integrations require the user to give permissions on an opt-in basis. Also: Every iPhone model that will be updated to Apple's iOS 18 (and which ones can't) The iPhone 16 and iPhone 16 Plus are available for pre-order from $799 and $899, respectively, but the Apple Intelligence features won't be readily available for some time. Apple says some of its AI features will begin rolling out in beta next month, with more features to come over the next several months.
[2]
Apple adds Google Lens-like Visual Intelligence to the iPhone 16 camera
The company upgraded the iPhone camera with AI-powered Visual Intelligence, giving users visual search straight from the camera app. Here's how it works. During Monday's iPhone 16 event, Apple announced a brand new lineup of iPhones, AirPods and AirPods Pro, AirPods Max, and an Apple Watch Series 10. Apple also took the opportunity to expand on some Apple Intelligence features, the artificial intelligence (AI) tools coming to the iPhone. This includes a new Visual Intelligence feature, which essentially gives the iPhone camera Google Lens capabilities. Apple's Visual Intelligence lets you capture a photo of things around you, like a flyer or a restaurant, and then uses iPhone's AI capability to search for it and give you more information. Also: Everything we expect at Apple's iPhone 16 event: AI features, AirPods, Apple Watch Series 10, more Apple says captured data will remain private when used with Apple Intelligence and the company's Private Cloud Compute, but users can opt for third-party integrations with the new camera experience. Third-party integrations include the ability to search Google for whatever the camera captures, much like opening Google Lens straight from the iPhone camera app. Users can also allow ChatGPT integration with the Visual Intelligence feature, which would allow the AI chatbot to process the image data captured by the camera. These third-party integrations require the user to give permissions on an opt-in basis. Also: Every iPhone model that will be updated to Apple's iOS 18 (and which ones can't) The iPhone 16 and iPhone 16 Plus are available for pre-order from $799 and $899, respectively, but the Apple Intelligence features won't be readily available for some time. Apple says some of its AI features will begin rolling out in beta next month, with more features to come over the next several months.
[3]
AI-powered visual search comes to the iPhone
Visual search is coming to the iPhone, powered by Apple Intelligence, Apple's suite of AI capabilities, the company announced at Monday's Apple Event 2024. The Camera Control, the new button on the iPhone 16 and 16 Plus, can launch what Apple calls "visual intelligence" -- basically a reverse image search combined with some text recognition. If you use visual intelligence to search for a restaurant, for example, it'll pull up restaurant hours, ratings and options to check out the menu or make a reservation, Apple says. Or, if you come across a flier for an event, you can use visual intelligence to quickly add the title, time, date and location to your calendar. Visual intelligence will launch along with other Apple Intelligence features in beta in October for U.S. English language users. Users in other countries can expect to get it December and early 2025.
Share
Share
Copy Link
Apple unveils Visual Intelligence, an AI-powered visual search feature for the iPhone 16 camera, rivaling Google Lens. This new technology aims to enhance user experience by providing instant information about objects in photos.
Apple's New Visual Intelligence Feature
Apple has announced a groundbreaking addition to its iPhone 16 camera system: Visual Intelligence. This AI-powered visual search feature is set to revolutionize how users interact with their surroundings through their smartphone cameras
1
.How Visual Intelligence Works
Visual Intelligence allows iPhone 16 users to point their camera at objects, text, or scenes to receive instant information and interactive options. By leveraging advanced AI algorithms, the feature can recognize and provide details about a wide range of items, from landmarks and plants to products and text
2
.Comparison to Google Lens
Apple's Visual Intelligence is being viewed as a direct competitor to Google Lens, which has been available on Android devices for several years. While both technologies offer similar functionalities, Apple's integration into the native iPhone camera app could provide a seamless user experience for iOS users
3
.Key Features and Applications
- Object Recognition: Identify plants, animals, landmarks, and everyday objects.
- Text Translation: Translate foreign language text in real-time.
- Shopping Integration: Find similar products or make purchases directly from recognized items.
- Information Retrieval: Access relevant information about recognized objects or locations.
Privacy and Security Considerations
Apple emphasizes that Visual Intelligence prioritizes user privacy. The company states that all processing occurs on-device, ensuring that personal data and image analysis remain secure and are not shared with external servers
1
.Related Stories
Impact on User Experience
The introduction of Visual Intelligence is expected to significantly enhance the iPhone's utility as a tool for exploration and information gathering. Users will be able to interact with their environment in new ways, potentially changing how they shop, travel, and learn
3
.Availability and Compatibility
Visual Intelligence will be available exclusively on the iPhone 16 series at launch. Apple has not yet announced plans for backward compatibility with older iPhone models, suggesting that the feature may require specific hardware capabilities present in the latest devices
2
.References
Summarized by
Navi
[3]
Related Stories
Apple's Visual Intelligence: A Game-Changer for iPhone 16 Camera and Photos App
10 Sept 2024
Apple Expands Visual Intelligence to iPhone 15 Pro: AI Feature Coming in Future Update
20 Feb 2025•Technology
Apple Expands Visual Intelligence to iPhone 15 Pro Models with iOS 18.4 Beta
04 Mar 2025•Technology
Weekly Highlights
1
Anthropic Secures $13B in Funding, Reaching $183B Valuation Amid AI Industry Boom
Business and Economy
2
Tesla Proposes $1 Trillion Pay Package for Elon Musk Tied to Ambitious AI and Robotics Goals
Business and Economy
3
Anthropic's $1.5B AI Copyright Settlement: A Landmark Deal Under Scrutiny
Policy and Regulation
Weekly Highlights
Explore today's top stories
Your Daily Dose of Curated AI News
Don’t drown in AI news. We cut through the noise - filtering, ranking and summarizing the most important AI news, breakthroughs and research daily. Spend less time searching for the latest in AI and get straight to action.
