Apple Vision Pro Gets AI Boost with visionOS 2.4 Update

Apple brings Apple Intelligence to the Vision Pro | TechCrunch

Apple announced on Monday that it's rolling out visionOS 2.4, bringing Apple Intelligence-powered AI features to the Apple Vision Pro. The update also introduces new spatial experiences and the Apple Vision Pro app for iPhone. With Apple Intelligence on the Apple Vision Pro, users will get access to writing tools that allow them to rewrite, proofread, and summarize text with the help of AI. Users will also get access to Image Playground and Genmoji in order to create unique AI-generated images and emoji. In addition, users can leverage natural language search in the Photos app to find specific images by simply describing them. Vision Pro users can also create a "Memory Movie" based on their photos and videos around specific themes, thanks to a new Apple Intelligence feature that's launching today. visionOS 2.4 also includes support for Priority Messages in Mail, Mail Summaries, Image Wand in Notes, Priority Notifications in Notification Center, and Notification Summaries. The first set of Apple Intelligence features is available to users with their device and Siri language set to U.S. English. As for the new spatial experiences, Apple is launching a new Spatial Gallery app that gives users access to a library of spatial content around art, culture, nature, sports, entertainment, and more. The app will be updated with new content regularly, Apple says. The new Apple Vision Pro app for iPhone allow users to do a variety of different things, including queuing apps to download, accessing information about their Vision Pro, and finding tips to enhance their experience. The app features a Discover page that surfaces recommendation for new experiences on Apple Vision Pro, such as popular apps and games. Apple today also announced that it's rolling out new Apple Intelligence features, including a "Priority Notifications" feature that aims to help users manage their notifications by prioritizing important alerts and minimizing distractions from less important ones on a user's Lock Screen. Plus, the tech giant is expanding Apple Intelligence access to the EU and rolling out support for new languages, including French, German, Italian, Portuguese (Brazil), Spanish, Japanese, Korean, and Chinese (simplified).

Is Apple Intelligence the Vision Pro's Missing Link? Hands On With visionOS 2.4

I've contributed to PCMag since 2019, covering all kinds of consumer electronics. As a self-identifying early adopter of technology, I've stumbled through the changing devices over the years and usually end up writing about how they work, why they're great, or how they could be better. Despite strapping an Apple Vision Pro to my head regularly for the last 12 months, the thought never crossed my mind that its missing piece is Apple Intelligence. I've dreamt of physical refinements, like a weight reduction, and I've pondered software enhancements for native controller support, but I've never wished for the headset to do image generation. So, the news that visionOS 2.4 brings Apple Intelligence to the Vision Pro is an intriguing proposal. With its M2 chip and 16GB of RAM, the device is powerful enough, and any updates are a welcome addition for current owners. But what about everyone else? Does AI make the Vision Pro more compelling for potential buyers? What's New in visionOS 2.4 In the lead-up to today's public release of visionOS 2.4, I've been testing the beta version. The headliner of the software is, of course, Apple Intelligence. That means Writing Tools, ChatGPT integration, Image Playground, Genmoji, and more make their appearance on the device. Beyond the AI features, a new Spatial Gallery app highlights 3D content. At launch, it includes behind-the-scenes clips from Apple Originals like Severance, The Studio, and The Morning Show and conversations with artists like Bad Bunny, Charli xcx, and Keith Urban, Apple says. There's also a new Vision Pro app for iPhones that better links the two devices. Browse apps and content on your phone and then send them to the headset; they'll be ready for you the next time you slide into the Vision Pro. The most intriguing new addition, however, is a revamp to Guest User. Using an iPhone, you can configure which apps a friend can and can't use from an iPhone or iPad. Apple Intelligence Does Not Revitalize the Vision Pro As it stands today, Apple Intelligence adds flourishes to whatever operating system it's a part of, but it doesn't fundamentally change the way the software works. Still, I went into testing the new update with an open mind. Maybe AI would bring a new layer of value. One of the small details I've found is the usefulness of Writing Tools on the Vision Pro. I haven't touched the feature on macOS or iOS, but they do seem a tad more useful on visionOS, where text entry is harder. Smart reply in Messages is also more helpful on the Vision Pro, which pre-fills suggestions for potential replies. Email and text message summaries are both helpful if you're using the device for long stretches of time as multiple notifications are coming in. However, since text entry without a keyboard can be tedious, typing out prompts for Genmoji and Image Playground isn't as easy as they are on a phone or tablet. I was hopeful, but Apple Intelligence doesn't change the equation for whether you should purchase a Vision Pro. If you're on the fence, wait it out. Guest User and Spatial Gallery Are the Highlights Even though Apple Intelligence isn't a game-changer on the headset, the addition of the Spatial Gallery and revisions to Guest User are notable upgrades. The visual content in the Spatial Gallery is still in its early stages, and yet I found myself captivated by what it shows off. There are random 3D photos and video clips with little cohesion, but seeing them made me want to view more. It also reminded me that I should shoot more spatial photos using my iPhone. Time will tell if Apple can fully utilize the Spatial Gallery app as a hub for content, but even with a basic framework, it's now obvious that it's needed. A robust guest mode should have been on the Vision Pro from day one when buyers were excited to show it off to family and friends. It's better late than never, I guess. I'm a big fan of how it automatically shows a live view of what the person is seeing. It's easier to help them along during their first time. The other featured addition is a Vision Pro app for iPhone. Anyone with iOS 18.4 can download it from the App Store, and it will allow Vision Pro owners to queue up apps and content while scrolling their phones. Meta already has this on its own apps, so it was a glaring omission on the Vision Pro at launch. As a result, the additions of visionOS 2.4 are a great step forward for current owners, but it doesn't make the Vision Pro a must-buy device.

Apple Intelligence for Vision Pro only available in US English

Apple on Monday released visionOS 2.4, and it's the first update to enable Apple Intelligence features in Apple Vision Pro. However, even though the update was released on the same day as iOS 18.4 - which expands AI capabilities to more languages - Apple Intelligence for Vision Pro is only available in English. In a note on Apple's website, the company notes that the first set of Apple Intelligence features for Vision Pro is only available in US English. This means that Vision Pro users must set both the system language and Siri to US English before enabling AI features. When Apple Intelligence arrived on iOS, it was also limited to US English. With iOS 18.2, Apple has expanded its AI tools to more variations of English. Now with iOS 18.4, Apple Intelligence is also available in French, German, Italian, Japanese, Korean, Portuguese, Chinese, and Spanish. The Apple Intelligence features in Vision Pro are pretty much the same as those already available on iPhone, iPad, and Mac. This includes Writing Tools, Image Playground, Genmoji, and text summarization. Apple hasn't made any specific AI features for Vision Pro, and it doesn't have Visual Intelligence like the iPhone. Since Vision Pro is only available in a few countries around the world, it's understandable that Apple hasn't rushed to add support for more languages just yet. In addition to Apple Intelligence, visionOS 2.4 adds a new Spatial Gallery app with photos, videos and spatial panoramas curated by Apple. The update also makes it easier to share a Vision Pro with a guest. You can install visionOS 2.4 by going to Settings > General > Software Update. It's worth noting that Apple Vision Pro is currently available in Australia, Canada, China mainland, Hong Kong, France, Germany, Japan, Korea, Singapore, Taiwan, the UAE, the UK, and the US.

Apple Vision Pro just got an Apple Intelligence upgrade

Apple has just released its latest visionOS 2.4 update and with it comes some AI super powers, compliments of Apple Intelligence. The latest update for the Apple Vision Pro headset can now be installed to take advantage of the very first set of Apple Intelligence tools to reach the augmented reality headset. Recommended Videos Apple says the new AI smarts will mean people can be helped to "communicate, write and express themselves." This should also help people find new content and apps more easily while also enhancing privacy in AI. And it lands alongside the new Spatial Gallery app for curated collections of art, culture, nature, sports and more. What does Apple Intelligence do in visionOS 2.4? The main addition that Apple Intelligence brings to the Vision Pro is a new writing tool. This break down into Rewrite, Proofread and Summarize. Rewrite allows you to take a chunk of text and have the AI adjust tone - perhaps making it more chatty, professional or concise. You can also describe a specific change and have the AI go and make that happen for you. Proofread does as you'd expect by checking grammar, sentence structure, word choices and - of course - suggesting edits. Summarize will let you select a body of text and then have that "recapped" in various formats. There is also a fourth tool, called Compose, which uses ChatGPT to let you generate content from the systemwide Writing Tools. System wide language is helpful but you also have area specific options like Smart Reply. This allows you to reply in Messages or Mail with quick responses. Plus you can search your Photos using natural language to find what you want. Image Playground also arrives on Vision Pro, allowing you to generate images from scratch using descriptions or photos of people you know, to save and share as you need. You can also create Genmoji with the AI to have even more fun ways to interact, using images to express yourself. Apple points out that, at time of publishing, this is only available to those people with their Siri language set to U.S. English.

Apple Intelligence Comes to Apple Vision Pro With visionOS 2.4 Update

The update also adds Priority Messages, Mail Summaries, and Smart Replies Apple released the visionOS 2.4 update for the Apple Vision Pro on Monday. It is considered a major update and introduces the first set of Apple Intelligence features for the mixed reality (MR) headset. According to the Cupertino-based technology giant, users can now leverage Writing Tools for summarising and editing text, Image Playground for reimagining photos, and natural language search in Photos to find the best memories quickly. Further, the update also bundles a new feature called Spatial Gallery which brings curations by Apple. Apple detailed the new features part of the visionOS 2.4 update in a newsroom post and the features are available on the headset with the device and Siri language set to English (US). The iPhone maker says Writing Tools is now available on the Apple Vision Pro. It is an AI-powered feature with options for composing, rewriting and proofreading documents with spelling and grammar checks. It can also summarise the text, create lists and tables, or highlight the key points from the text. The update brings Image Playground, a standalone app which leverages generative AI to create images based on descriptive prompts. Users can select a reference person from their Photos app for inspiration and can choose from different art styles. The same app also bundles Genmoji which works similarly but for emojis. Apple says these can be added inline to messages, shared as a sticker, or sent as a Tapback. Apple Intelligence now allows users to search for specific images stored in the Photos app with natural language queries. Further, the Create a Memory Movie enables AI to craft a storyline with chapters based on themes identified from the photos, and arrange them into a movie with a narrative arc, depending upon the prompt entered by the user. Meanwhile, Smart Reply in Mail and Messages allows for quick replies. Apple says visionOS 2.4 also brings support for Priority Messages in Mail, Mail Summaries, Image Wand in Notes, Priority Notifications in Notification Centre, and Notification Summaries. The company emphasises that photos and videos used to create movies and other actions are kept private and not shared with the company. Additionally, Apple Intelligence uses on-device processing whenever possible to protect user privacy. For tasks that require larger AI models, Apple engages Private Cloud Compute and the users' data is never stored or shared with the company.

Apple Launches visionOS 2.4: Transforming the Apple Vision Pro Experience with AI-Powered Features

Apple Vision Pro receives Apple Intelligence capabilities Apple has made a revolutionary announcement that will transform the future of augmented and mixed reality with the release of visionOS 2.4 for its Apple Vision Pro headset. The major update, announced on Monday, brings a slew of groundbreaking features based on Apple Intelligence to improve user interaction, creativity, and productivity. Enhancing the Vision Pro with advanced AI capabilities, new spatial experiences, and a dedicated app for iPhone users, visionOS 2.4 boosts the usability of the Vision Pro while changing how users interact with their digital environments. Apple has conspired to push more innovation into the technology realm; hence, this update is a courageous step into the future of immersive experience and an exciting development for consumers and developers frankly.