Apple Intelligence Powers New Accessibility Features for Vision Pro, iPhone, and Mac

Apple Intelligence Brings Accessibility Updates Across iPhone, Mac and Vision Pro

Named a Tech Media Trailblazer by the Consumer Technology Association in 2019, a winner of SPJ NorCal's Excellence in Journalism Awards in 2022 and has three times been a finalist in the LA Press Club's National Arts & Entertainment Journalism Awards. Apple is leveraging AI to boost its accessibility features. The company shared a handful of updates on Tuesday designed to make its products more helpful for people with a range of disabilities. Apple Intelligence, the tech giant's suite of AI features, powers some of these new capabilities. The unveiling comes ahead of Global Accessibility Awareness Day on Thursday, which aims to bolster digital access and inclusion. The updates are arriving for features like VoiceOver, Magnifier and video subtitles later this year. They come as more companies -- from Google to Microsoft to Amazon -- are harnessing AI to make their products and platforms accessible to a wider range of people. Many of Apple's updates build upon features it announced last year. They also come ahead of the company's Worldwide Developers Conference, which is scheduled for June 8 and is expected to usher in more AI updates. Apple's VoiceOver and Magnifier features can describe on-screen information or real-world settings, and Apple Intelligence is pushing each to be more helpful. VoiceOver is a screen reader that speaks aloud what's on your screen, and it can help people who are blind or have low vision navigate their device. Image Explorer in VoiceOver will now give more detailed descriptions of what's in objects like photographs, scanned bills and personal records. And as part of an update to Live Recognition, you can use your iPhone's Action button to quickly gather more information about your surroundings. Just point the camera at what you want to learn more about and ask follow-up questions for additional details. Magnifier allows people who are low vision to zoom in, view high-contrast text and detect objects around them on an iPhone, iPad or Mac. Now, you can ask questions about what your camera is seeing. For instance, you can point your phone at a recipe and ask how many servings it yields or how long to bake for, and it'll find and share that information using large, high-contrast text. Apple Intelligence will also support natural language using Voice Control, which lets you navigate your iPhone or iPad with your voice. That means if you want to click on something, you no longer have to pinpoint the location using a numbered on-screen grid. Instead, you can just say what you want to select, like a specific file name or folder color. You can also tell your device where you want to zoom in by stating which word or image you want to punch in on. Voice Control with Apple Intelligence will be available in English in the US, Canada, UK and Australia. Apple debuted Accessibility Reader last year on iPhone, iPad, Mac and Vision Pro. It lets you customize text and adjust font, color and spacing, making it easier for some people to read, such as those with low vision or dyslexia. Now, Accessibility Reader can work on more complex materials like scientific articles, which tend to format text in multiple columns among several images and tables. You can also remove headers and page numbers for a simpler interface and generate summaries for a quick overview before diving in. Plus, you can translate the text into your ideal language. Closed captioning may be nearly ubiquitous in TV programming and movies, but it isn't as common in some media like personal videos. Now, generated subtitles automatically display transcriptions of spoken audio when captions or subtitles aren't already available. That includes videos recorded from an iPhone, sent by friends and family or streamed online. On-device speech recognition generates the subtitles privately. They'll appear in non-captioned videos on iPhone, iPad, Mac, Apple TV and Vision Pro. You can customize elements like font and text background in the video playback menu or in settings. Generated subtitles will be available in English in the US and Canada. A new eye-tracking feature on Vision Pro allows people to control their power wheelchair -- no joystick required. They can use eye gaze to select controls and determine how and where their wheelchair moves. This can be especially helpful for people with limited mobility. Eye tracking on Vision Pro doesn't require regular calibration and can work in a variety of lighting conditions, according to Apple. The feature will be compatible with Tolt Technologies and Luci alternative drive systems in the US, with support for both Bluetooth and wired accessory connections. Apple says it'll work with developers to expand access to more wheelchairs. "Over the past decade, we've seen eye-driven wheelchair systems evolve in incredible ways," Blair Casey, CEO of Team Gleason, said in a statement. "Leveraging Apple Vision Pro's eye-tracking capabilities in this way is a huge step forward. Team Gleason is proud to support this initiative and excited to see the benefits it can bring to people who use power wheelchairs." Apple debuted the Hikawa Phone Grip and Stand late last year for the iPhone. It's an adaptive, ergonomic accessory that was designed using input from people with a range of disabilities, including ones affecting dexterity, grip and hand control. Now, as part of a collaboration between Hikawa and PopSockets, the accessory is on sale globally for the first time, and in three new colors. It's available starting today on Apple's website.

Apple's accessibility features add more AI-powered processing

One addition that jumped out to me is the ability to use on-device speech recognition for uncaptioned videos, which will be available on iPhone, iPad, Mac, Apple TV, and Apple Vision Pro. Other changes coming later this year will use AI to add more details to VoiceOver's Image Explorer in descriptions of images (with a warning that they should not be relied on in any number of risky or potentially dangerous situations), and the ability to ask questions about what the camera sees by pressing the Action button. It's also adding natural language navigation to the Voice Control system, and the Accessibility Reader will be ready to summarize more complex material.

Apple's New Accessibility Features Include Wheelchair Control for Vision Pro

The Vision Pro will use its precision eye-tracking system to record directional inputs. It's part of a suite of accessibility updates Apple announced today. Apple has announced a new set of accessibility features for its devices, including a Vision Pro update that lets users control compatible wheelchairs with eye movements. The new features are set to roll out later this year, and some are powered by Apple Intelligence. "With Apple Intelligence, we are bringing powerful new capabilities into our accessibility features while maintaining our foundational commitment to privacy by design," says Apple CEO Tim Cook. For wheelchair support, the Vision Pro will use its precision eye-tracking system to record directional inputs. In a promotional video, Apple shows that a wearer can move their wheelchair in eight directions and stop or pause its motion using eye movements. The feature will benefit those unable to operate a power wheelchair's joystick, Apple says. Since the feature uses Vision Pro's eye-tracking, it will work in various lighting conditions and won't require frequent calibration, the company adds. At launch, Vision Pro's wheelchair control will be supported by Tolt and LUCI alternative drive systems in the US. Support for more wheelchairs will be added in the future. VoiceOver, Magnifier, and Voice Control Get AI Smarts VoiceOver, a feature that reads out screen contents to help people with low vision navigate their iPhones, is getting smarter with Apple Intelligence. The Image Explorer in VoiceOver will soon provide more detailed descriptions for photographs, scanned bills, personal records, and other visual content. With an update to Live Recognition, users will also be able to press the Action Button to launch the camera and ask questions about what's in their camera viewfinder. They can also ask follow-up questions. Magnifier, an app that allows people to use their phone camera to zoom in on objects or text in front of them, will soon provide better descriptions for high-contrast app interfaces or websites in voice mode. Users will also be able to use the Action Button to ask questions and provide voice commands such as "zoom in" or "turn on flashlight." With Voice Control, an accessibility feature that allows users to scroll or tap items on their screen using voice commands, users will soon be able to "describe onscreen buttons and controls with natural language instead of memorizing exact labels or numbers," according to Apple. For example, they could just say "tap the purple folder" instead of the folder name to open it. AI Subtitles for Personal Videos While most streaming content comes with closed captions or subtitles by default, personal videos you receive from friends and family do not. To help people who are deaf or hard of hearing understand video content better, Apple will use on-device speech recognition to add subtitles to uncaptioned videos on iPhone, iPad, Mac, Apple TV, and Apple Vision Pro. Appearance of the captions will be modifiable from device Settings. Other accessibility improvements announced by Apple include expanded text support for Accessibility Reader and Larger Text support on tvOS. Apple is also rolling out three new variants for the triangular Hikawa iPhone grip launched last year.

Apple adds AI smarts to Voice Control, VoiceOver and Magnifier ahead of Accessibility Day

Natural language commands and better image descriptions but Mac users and dictation fans may still be waiting Apple has previewed a new batch of accessibility features coming later this year, with Apple Intelligence being used to improve Voice Control, VoiceOver, Magnifier and generated subtitles across its devices. The announcement came ahead of Global Accessibility Awareness Day, which falls today as we publish this article, on Thursday, May 21, and is the annual moment when technology companies often set out new work on digital access and inclusion. The most interesting change for anyone who relies on hands-free access is an update to Voice Control. Apple says users will be able to describe onscreen controls in more natural language, rather than having to remember exact labels, overlays, or rigid commands. Examples given by Apple include phrases such as "tap the guide about best restaurants" or "tap the purple folder." The company also says the feature could help when app controls are not labelled properly for accessibility. That may sound like a small change, but for disabled people who use voice as their main way of operating an iPhone or iPad, it could make a real difference. Voice Control is already one of Apple's most important accessibility tools, but it can still be brittle. If the wording does not match what the system expects, the command can fail. A more flexible "say what you see" approach could make voice navigation feel less like issuing machine instructions and more like asking for what you want. Apple says Voice Control powered by Apple Intelligence will be available in English in the UK, US, Canada and Australia later this year. However, Apple's announcement specifically describes the new natural language navigation as helping people navigate iPhone and iPad by voice, with no clear mention of Mac support for this particular Voice Control update. That absence is important. For many people who rely on Voice Control, the Mac is not a secondary device. It is where longer writing, work, email and publishing happen. If natural language Voice Control launches first on iPhone and iPad only, Mac users may still be left waiting for the AI-assisted voice access that would help most with daily work. Apple is also using Apple Intelligence to improve visual description tools. VoiceOver's Image Explorer will provide more detailed descriptions of images, including photos, scanned documents and other visual content. Apple also says users will be able to ask follow-up questions about what appears in the iPhone camera viewfinder. Magnifier will gain similar AI-powered description features, along with spoken controls such as "zoom in" and "turn on flashlight." There is a new generated subtitles feature for videos that do not already include captions. Apple says this will use on-device speech recognition and work across iPhone, iPad, Mac, Apple TV, and Apple Vision Pro. For deaf and hard-of-hearing people, that could be useful. It may also help anyone dealing with personal videos, shared clips or online content where captions are missing. However, generated subtitles will initially be limited to English in the US and Canada. One of the more striking announcements is a new Apple Vision Pro feature that will allow compatible power wheelchair drive systems to be controlled with eye tracking. Apple says the feature will support Tolt and LUCI alternative drive systems in the United States, using Bluetooth or a wired connection. For some powered wheelchair users who cannot operate a joystick, that could be valuable. Wheelchair control is not a niche issue for the people affected by it. It is about independence, safety and the basic ability to move through the world. But there are obvious practical questions here, starting with Vision Pro itself. As a full-time electric wheelchair user, I would not be seen dead driving down my high street wearing an Apple Vision Pro headset. It is bulky, heavy and visually conspicuous. More seriously, I would not want to see severely disabled people expected to wear one for long periods to control a wheelchair, especially when many already deal with fatigue, posture problems, respiratory weakness or limited head and neck strength. Cost is another barrier. Many disabled people live in poverty, and the Apple Vision Pro's UK starting price of £3,499 (the Stateside starting price is slightly lower at $3,499 ) would put it out of reach for many. That would come on top of the cost of any compatible wheelchair drive system, support, setup, and maintenance. A feature can be technically impressive and still remain impractical if the hardware required is far too expensive. That does not make the announcement unimportant. It may be most interesting as a sign of where the technology could go next. I would look at this very differently if the same kind of eye-control system eventually arrived on more traditional Apple smart glasses: lightweight, socially acceptable and practical to wear for long periods. That is where the idea could become more useful for people who struggle to use a wheelchair joystick. Vision Pro may be the early test bed, but lightweight glasses could be the form factor that makes this kind of wheelchair control usable. For now, this looks like an early and specialist step. Wheelchair control is safety-critical, so it will need careful testing, strong safeguards and real-world feedback from disabled people before anyone can judge its value properly. I am glad Apple is looking at the issue. The current implementation may not be practical for many people, but the underlying idea deserves attention. Calls for a smarter Voice Control are not new. In 2023, I wrote for The Register that Apple needed to bring more AI into Voice Control, especially to improve dictation accuracy and support people with non-standard speech. At the time, I argued that Personal Voice showed Apple already had some of the underlying technology to understand an individual voice more deeply. The obvious question was whether that intelligence could be applied to recognition as well as voice generation. Apple now appears to be taking a step in that direction, but with navigation rather than dictation. That is still useful. Voice Control needs to become less rigid if it is to serve people who depend on it every day. But it leaves a larger issue unresolved. Apple still has a dictation gap to close The wider voice-accessibility picture is now complicated. Apps such as Aqua Voice have shown how good AI-powered dictation can be. For many people, these newer tools are far more accurate and natural than traditional built-in dictation systems. They are especially strong at turning spoken thoughts into clean text without the user having to micromanage every comma and correction. Apple's Voice Control is still one of the few mainstream tools that can control the operating system itself by voice. It can open apps, tap buttons, select menus, scroll pages and move around the interface. Third-party AI dictation apps may be better at writing, but they do not have the same deep system access. That leaves disabled people in an odd place. The best dictation experience may come from one app, while the best hands-free control still comes from the operating system. For people who cannot easily touch a screen, keyboard or mouse, the ideal future is not choosing between accurate dictation and reliable control. It is having both work together. That is why this Voice Control update is worth watching. It suggests Apple is starting to apply newer AI methods to one of its most important accessibility tools. But the next step should be more ambitious: a system-level way for advanced dictation and accessibility controls to work together. Whether Apple builds this itself or opens up deeper accessibility APIs for trusted apps, the goal should be the same. Users should be able to dictate accurately, correct text, move around apps, press buttons, send messages and control the operating system without switching between separate voice tools. Call it Universal Accessibility Control, or simply the next generation of Voice Control. The name matters less than the result: one joined-up voice experience that combines accurate dictation, command recognition and hands-free navigation. For now, Apple appears to be improving navigation before it tackles the harder dictation problem. Apple's announcement also includes larger text support on tvOS, expanded Name Recognition, new FaceTime APIs for sign language interpreter apps, Vehicle Motion Cues for Vision Pro, and wider support for adaptive gaming controllers. But the Voice Control update is likely to attract the most attention from people who rely on hands-free access. Apple has not announced a major Siri accessibility overhaul here. Nor has it announced major changes to Personal Voice, Vocal Shortcuts or atypical speech recognition in this particular update. The company also has not said whether it plans to make Apple Watch more accessible to disabled people with severe upper limb disabilities. Natural language Voice Control could be valuable if it works reliably. For disabled people, accessibility features are not just nice additions. They are often the difference between using a device independently and not using it at all. The announcement is encouraging, coinciding with Global Accessibility Awareness Day. But Apple should not stop at making Voice Control more conversational. The larger task is to treat dictation, correction and navigation as parts of the same workflow. The test comes later this year, when disabled people can try these features in daily life. The longer term question is whether Apple can turn this first AI step into a fuller model of hands-free computing. ®

Apple's new accessibility feature lets Vision Pro users control a wheelchair with their eyes - Engadget

New detailed descriptions and natural language navigation features will be powered by Apple Intelligence. Apple is previewing new accessibility features including Apple Intelligence-powered updates like natural language voice input, along with a new Vision Pro app that allows eye control for motorized wheelchairs. The updates, revealed just ahead of Global Accessibility Awareness Day (GAAD) on May 21, arrive later this year. "With Apple Intelligence, we are bringing powerful new capabilities into our accessibility features while maintaining our foundational commitment to privacy by design," said Apple CEO Tim Cook. The Image Explorer in VoiceOver now uses Apple Intelligence to give more detailed descriptions of images system-wide, including photos (which often lack detailed alt-descriptions), scanned bills, personal records and other content. "With updates to Live Recognition, VoiceOver users can press the Action button on iPhone to quickly ask a question about what's in the camera viewfinder and get a detailed response" and ask follow-up questions, Apple said. Magnifier, meanwhile, will use Apple Intelligence to bring visual descriptions to its high-contrast interface for users with low vision. It also works with the Action button, allowing users to quickly get answer to questions and control the app itself with spoken requests like "zoom in" or "turn on the flashlight." Another big AI addition is natural language for Apple's Voice Control function. "With a new flexible input, users can describe onscreen buttons and controls with natural language instead of memorizing exact labels or numbers," Apple wrote. That will work for navigating any app including those with visual layouts like Apple Maps or Files. For example, users can say things like "tap the guide about best restaurants," or "tap the purple folder." The function could also help users when app elements aren't labeled correctly for accessibility. Accessibility Reader is also getting a dose of Apple Intelligence. It can now work on more complex material like scientific articles or text with multiple columns, images and tables, providing on-demand summaries of articles so readers can get an overview before diving into the details. Another new function is built-in translation that lets users read in their native language while retaining custom formatting, fonts and colors. Generated subtitles, meanwhile provide captions for "personal videos, content shared by friends and family, and other media," rather than just video from platforms like YouTube and Facebook. Customizable subtitles are generated on-device for privacy and appear automatically for un-captioned videos on iPhone, iPad, Mac, Apple TV and Apple Vision Pro. Finally, Apple introduced a new wheelchair control feature for Apple Vision Pro. Using the precision eye-tracking system on the headsets, the new power wheelchair control feature offers a "responsive input method for compatible alternative drive systems." It doesn't require frequent recalibration and works in a variety of lighting conditions, offering compatibility with TOLT and LUCI alternative drive systems with accessory support for Bluetooh and wired connections. "The option to control my power wheelchair on my own is gold to me," said Pat Dolan, who has lived with ALS for 10 years and is a founder of GeoALS. "With this new feature, Apple is developing life-enhancing technology for the people who need it most."

Apple announces AI-powered accessibility features and eye-control of wheelchairs

Apple has today announced that it's using AI to boost the power of a number of accessibility features. These include VoiceOver, Magnifier, Voice Control and Accessibility Reader. Additionally, power wheelchair users will now be able to use their eyes as controls when using Vision Pro ... Apple says that it has not compromised privacy when adding AI capabilities to its accessibility features. "Apple's approach to accessibility is unlike any other," said Tim Cook, Apple's CEO. "Now, with Apple Intelligence, we are bringing powerful new capabilities into our accessibility features while maintaining our foundational commitment to privacy by design." "The accessibility features our users rely on every day become even more powerful with Apple Intelligence," said Sarah Herrlinger, Apple's senior director of Global Accessibility Policy and Initiatives. "With these updates, we're bringing new, intuitive options for input, exploration, and personalization -- designed to protect users' privacy at every step." VoiceOver and Magnifier assist users who are blind or have low vision to understand both on-screen information and their surroundings. Both are getting an AI boost. The Image Explorer in VoiceOver uses Apple Intelligence to give more detailed descriptions of images systemwide, including what's in photographs, scanned bills, personal records, and other visual content. With updates to Live Recognition, VoiceOver users can press the Action button on iPhone to quickly ask a question about what's in the camera viewfinder and get a detailed response. Users can also ask follow-up questions in their own words to get more visual information. Magnifier also works with the Action button so users can quickly ask questions and get answers. And users can control the app itself with spoken requests, such as "zoom in" or "turn on flashlight." Voice Control has so far required users to memorize exact words and phrases. With AI, Apple says that the feature now allows people to use natural language. With a new flexible input, users can describe onscreen buttons and controls with natural language instead of memorizing exact labels or numbers. The option to "say what you see" is great for navigating any app, including those with visual layouts such as Apple Maps or Files, using intuitive language like "tap the guide about best restaurants" or "tap the purple folder." This can also help users overcome barriers when elements aren't properly labeled for accessibility. For those who struggle to read text, Accessibility Reader is now significantly smarter. Accessibility Reader is a customized reading experience for users with a wide range of disabilities, from dyslexia to low vision, and with Apple Intelligence, the reading experience is more accessible than ever. Accessibility Reader works on more complex source material like scientific articles, handling text with multiple columns, images, and tables. On-demand summaries provide readers the option to get an overview of the article before diving into the details. And with new built-in translation, users can read text in their native language while retaining custom formatting, font, and colors. Any video can now be captioned with AI-generated subtitles. This includes video clips received from family and friends as well as those streamed online. This has the potential to be transformative for users who are deaf or hard of hearing. On-device captioning is used in order to preserve privacy. While captioning solutions are increasingly common for users who are deaf or hard of hearing, subtitles for spoken dialogue are rarely available for personal videos, content shared by friends and family, and other media. With new generated subtitles, videos can display transcriptions of spoken audio automatically when captions or subtitles are not already provided, including in clips recorded on iPhone, received from friends and family, or streamed online. With on-device speech recognition, subtitles are generated privately and appear automatically for uncaptioned videos on iPhone, iPad, Mac, Apple TV, and Apple Vision Pro. While some power wheelchair users have sufficient movement to use joystick controls, this isn't true for everyone. Users will now be able to use eye control within Vision Pro. Leveraging the precision eye-tracking system on Apple Vision Pro, a new power wheelchair control feature offers users a responsive input method for compatible alternative drive systems. With Vision Pro, eye tracking doesn't require frequent recalibration and works in a variety of lighting conditions. The feature launches with Tolt and LUCI alternative drive systems in the U.S., with accessory support for both Bluetooth and wired connections. Apple says further wheelchairs will be supported over time. Apple also listed a number of additional accessibility enhancements. AI is about much more than chatbots. While Apple has been criticized for being slow to adopt AI features, accessibility features is certainly an excellent priority. It also indicates that there will be many other things on which the company is quietly working behind the scenes. I very much hope to see a lot of further AI developments announced at WWDC.

Apple announces new accessibility features powered by AI for your iPhone: what you need to know

Apple has announced a suite of new accessibility features that are powered by Apple Intelligence. These tools include VoiceOver, Voice Control, Magnifier and an Accessibility Reader that work with your iPhone. Additionally, the company announced new eye controls for wheel chair users who have an Apple Vision Pro. Plus, the accessibility designed Hikawa Grip & Stand for iPhone comes in three new colors. All of the features are "coming later this year." The announcement didn't specify when each individual feature will actually be available. "With these updates, we're bringing new, intuitive options for input, exploration, and personalization -- designed to protect users' privacy at every step," Sarah Herrlinger, Apple's senior director of Global Accessibility Policy and Initiatives, said in the announcement. Here's what they are and how they work. VoiceOver and Magnifier VoiceOver and Magnifier is meant for users who are blind or have low vision. They can describe onscreen information or your surroundings using Apple Intelligence. In VoiceOver, the Image Explorer uses AI to give detailed descriptions of images in your phone. Examples include photographs, scanned bills, personal records and other visuals. Apple is also updating Live Recognition, which can use your camera to get a response about whats in the viewfinder. You can also ask follow-up questions to get more information. Magnifier is a high-contrast interface that also utilizes the Action button to ask questions and receive answers. You can control the app with spoken requests like "turn on flashlight" and "zoom in." Voice Control updates Voice Control is getting a natural language update that lets you navigate your iPhone or iPad entirely by voice. It's supposed to let you describe onscreen buttons and controls with conversational language instead of memorizing exact labels or numbers. You can say commands like "say what you see" or "tap the purple folder" to control your device. It's meant to make it easier to use your iPhone or get around barriers like improperly labeled elements. Accessibility reader and subtitles Accessibility reader is meant for a range of visual impairments from dyslexia to low vision. According to Apple, Accessibility Reader can handle complex source material like scientific articles. It can provide on-demand summaries, built-in translation and custom formatting, font and colors to help you read better. Additionally, Apple devices, including the iPhone, iPad, Mac, Apple TV and Vision Pro, are getting a new subtitle generation feature for uncaptioned videos. Apple Intelligence will recognize speech and generate subtitles for even videos sent from family and friends in messages. Vision Pro wheelchair control Designed for users of power wheelchairs, Apple has a new precision-eyetracking system for the Vision Pro that enables people to use their eyes to control the chairs. It's helpful for people who can't easily use a joystick and need an alternative drive system. Apple says the system works in a variety of lighting conditions and doesn't require frequent recalibration. "The option to control my power wheelchair on my own is gold to me," said Pat Dolan, founder of GeoALS and a member of Team Gleason's patient advisory board, who has lived with ALS for 10 years. "With this new feature, Apple is developing life-enhancing technology for the people who need it most." Other accessibility features Apple has a variety other accessibility features that you may find helpful. * Vehicle motion cues: reduce motion sickness for people using Vision Pros as a passenger in cars. * Touch accommodations: New personalized setups in iOS and iPadOS * Made for iPhone hearing aids: more reliable pairing between Apple devices * Larger text: tvOS is getting larger text options for low vision users * Name recognition: Can notify deaf or hard-of-hearing people if someone says their name nearby. * Connect the Sony Access game controller to iOS, iPadOS, or macOS devices. You can configure the thumbstick, nine built-in buttons, and four external buttons or speciality switches to personalize layouts. Follow Tom's Guide on Google News and add us as a preferred source to get our up-to-date news, analysis, and reviews in your feeds. Subscribe to Tom's Guide on YouTube and follow us on TikTok. Finally, you can visit our dedicated Tom's Guide Savings Squad hub for expert help on getting the best products for less.

Apple's AI accessibility upgrades: Video captioning, eye-powered wheelchairs

Apple Intelligence is powering Apple's new accessibility features. Credit: Apple Apple Intelligence is coming to the company's industry-leading accessibility tools, including upgraded vision, captioning, and mobility features now enhanced with machine learning. In honor of Global Accessibility Awareness Day, which falls on May 21, the tech giant announced a suite of new AI-powered capabilities for the Apple ecosystem, covering its most popular accessibility offerings like VoiceOver, Magnifier, Voice Control, and Reader. "Apple's approach to accessibility is unlike any other. Now, with Apple Intelligence, we are bringing powerful new capabilities into our accessibility features while maintaining our foundational commitment to privacy by design," said CEO Tim Cook. Many of the new upgrades come to Apple's vision and voice control tools, designed for users who are blind or have low vision and those with various ranges of mobility. With Image Explorer, part of Apple's gesture-based screen reader known as VoiceOver, users can get more detailed descriptions of device displays and content. VoiceOver's Live Recognition feature can be activated by the iPhone Action button and respond to detailed follow-up questions. Instead of relying on memorizing specific commands or locations on a screen, iPhone and iPad users will be able to use natural language commands to navigate their devices using Voice Control and on-device tools like Magnifier. That means a user can simply ask their device to "tap the orange folder" or "zoom in on that word," and the device will respond -- Apple calls it the power to just "say what you see." Apple's AI can also automatically generate on-device subtitles for uncaptioned video, including content taken on-device by Apple users, video sent to users without captions, and even streamed video. The company's Accessibility Reader tool is getting an upgrade that will make it possible to navigate complicated text, like scientific studies with columns, images, and tables, provide more on-demand summaries, and translate languages without changing custom formatting. Last, but certainly not least, Apple is adding a feature to Apple Vision Pro that will allow power wheelchair users to navigate their mobility devices using just the virtual reality headset. The company explained that the feature leverages the device's eye-tracking -- technology already used to power alternative drive controls, device navigation, and communication tools for people with various disabilities -- but requires less frequent calibration than typical drive control devices. Apple still recommends users only use Apple Vision Pro headsets in controlled environments without potential obstacles or inclement weather, however. Additionally, Apple is making it easier to pair and hand off Made for iPhone hearing aids when switching devices, and add in human ASL interpreters to ongoing FaceTime calls. Apple tvOS is getting larger text support for people with low vision, and Name Recognition is expanding to 50 languages. Apple said the upgraded tools and features will roll out later this year. The company also said it was expanding its collaborative Hikawa Grip & Stand line, a third-party accessibility accessory designed by artist Bailey Hikawa and released for a limited time last year.

Apple unveils new AI-powered accessibility features across iPhone, Mac, and Vision Pro

Apple Intelligence is coming to accessibility features across its ecosystem Apple has announced a major set of accessibility updates across iPhone, iPad, Mac, Apple Vision Pro, and Apple TV, with many of the new features powered by Apple Intelligence. The company says the updates are designed to make devices more useful for users with visual, hearing, mobility, and learning disabilities while maintaining Apple's privacy-focused approach to AI. The new accessibility features will roll out later this year as part of Apple's upcoming software updates. Apple is bringing AI into accessibility features One of the biggest updates focuses on VoiceOver and Magnifier for users who are blind or have low vision. Apple says VoiceOver's new "Image Explorer" feature can now provide more detailed descriptions of photos, scanned documents, bills, and other visual content using Apple Intelligence. Users will also be able to ask follow-up questions about what the camera sees through the iPhone's Action button. Magnifier is also getting AI-powered visual descriptions and voice controls. Users can ask spoken commands such as "zoom in" or "turn on flashlight" while using the feature. Recommended Videos Apple is additionally improving Voice Control with natural-language interactions. Instead of memorising exact button labels, users can now describe what they see on screen with phrases like "tap the purple folder" or "open the restaurant guide." The company says this should make navigating apps easier for users with physical disabilities. Generated subtitles and smarter reading features Apple is also introducing automatically generated subtitles for videos without captions. The feature uses on-device speech recognition to create subtitles privately for personal videos, streamed content, and clips shared by friends or family. Generated subtitles will work across iPhone, iPad, Mac, Apple TV, and Apple Vision Pro. Another update expands Accessibility Reader, which is aimed at users with dyslexia or low vision. The feature will now support more complex content such as scientific articles with columns, tables, and images. AI-generated summaries and built-in translation tools are also being added. Apple Vision Pro gains eye-controlled wheelchair support One of the more notable announcements involves Apple Vision Pro. Apple says users with compatible alternative wheelchair drive systems will soon be able to control power wheelchairs using Vision Pro's eye-tracking system. The feature will initially support Tolt and LUCI systems in the US. The company also announced additional Vision Pro accessibility updates, including face gestures, improved Dwell Control, and motion sickness reduction tools for passengers in moving vehicles. Why these features matter Accessibility has long been a major focus area for Apple, but the latest updates show how AI is increasingly becoming part of assistive technology. Instead of positioning AI only as a productivity or chatbot tool, Apple is integrating it into real-world accessibility functions such as visual understanding, navigation, reading assistance, and communication. The company is also continuing to emphasize on-device processing and privacy, especially as AI-generated features become more common across consumer devices. Apple says the new accessibility features will launch later this year across its ecosystem. The company is expected to share more details during WWDC, where it will likely showcase how Apple Intelligence powers these updates across iOS, iPadOS, macOS, and visionOS.

Apple's New AI-Powered Accessibility Features Could Change the Way You Use Your iPhone

Your Apple device will also be able to generate live subtitles on any video that doesn't have them, including your own clips. In all likelihood, Apple won't acknowledge iOS 27's existence until WWDC 2026, but that doesn't mean the company is saving all its iOS 27 announcements until then. On Tuesday, Apple published a press release announcing a slew of new accessibility features coming "later this year." While Apple didn't specify, that almost assuredly means they will arrive with iOS 27. Apple does have a good track record when it comes to accessibility features, and it usually announces a slate of new accessibility updates ahead of WWDC. But this year feels a bit different: While these features will indeed likely benefit users with limitations or special needs, Apple also advertises them as "powered by Apple Intelligence." This is almost certainly the company's way of signaling to the tech community (as well as investors) that it is continuing to take AI seriously, especially after two years of slowdowns and setbacks. Moreover, several of these features seem widely useful, whether you "need" them or not. Perhaps the most universally useful new upgrade is to Voice Control. While Apple currently lets you use Voice Control to navigate your iPhone with spoken commands, Apple Intelligence will let you use Voice Control with natural language. That means instead of asking Voice Control to tap an input at a certain grid number, you can say "Open the yellow folder" in Files, or "tap the 'Best Restaurants' guide" in Maps. This is going to be huge for users who rely on Voice Control to use their iPhone or iPad. But it also shows that Apple Intelligence has advanced to the point where any of us can control these devices with our voices. If you need to use your iPhone hands-free for any reason -- say, you want to check a recipe while cooking -- you could direct your iPhone with your voice, rather than wash your hands, find the right recipe, then wash your hands again. Apple says that with its future update, Apple Intelligence will be able to caption videos whenever subtitles aren't present. That could work on a clip you watch online that doesn't have subtitles, or on a video you filmed yourself. This will happen automatically on your iPhone, iPad, Mac, Apple TV, and Apple Vision Pro, and Apple says the entire process is processed privately on-device (though it can be toggled on or off). Apple says later this year, VoiceOver and Magnifier will be able to describe what's on your screen -- which, when paired with the camera, means your phone will be able to describe what's going on around you. You'll be able to use the "Image Explorer" in VoiceOver to receive descriptions of photos, bills, records, and anything else you feed it. With Live Recognition, Apple Intelligence will be able to describe what's going on in the camera view, similar to how competitor products like Gemini Live work. To that point, Apple says you will also be able to ask follow-up questions "in your own words," which makes the experience a bit more of a back-and-forth, rather than constantly pinging the assistant. The Magnifier option makes it easier for users with low vision to see certain elements up close. After the upgrade, though, when hovering Maginifier's camera over a document or a receipt, you'll also be able to ask Apple Intelligence questions about the subject For example, you could ask "How much is the bill for?" and get a full answer with context. You can also use voice commands to take actions, like "zoom in" or "turn on the flashlight." Apple's Accessibility Reader can make it easier to read bodies of text with customizable fonts, backgrounds, layouts, and colors. Now, with Apple Intelligence, Accessibility Reader will work across "more complex source materials." That includes scientific articles, text printed in multiple columns, as well as images and data tables. The feature will also offer summaries, so you can get the gist of the material before reading on. Apple has a few new Vision Pro upgrades coming this fall as well. First, the company is adding a new wheelchair control feature to the headset, which will allow users in power wheelchairs to control their wheelchairs with eye movements. In addition, Apple announced that Vehicle Motion Cues are coming to the headset. This feature, previously an iOS-exclusive, adds moving dots to the display to counteract the effects of motion sickness. It will be interesting to see if it can help combat motion sickness that is sometimes caused by using the Apple Vision Pro in a moving vehicle. Finally, users will have new options to perform taps and system actions via face gestures. In addition to the above, Apple is adding the following accessibility options to iOS 27:

Apple Wants AI to Make iPhone More Accessible With These Features

Accessibility Reader supports complex layouts like scientific papers Apple on Tuesday announced a new suite of accessibility features powered by Apple Intelligence. Ahead of Worldwide Developers Conference (WWDC) 2026, the Cupertino-based tech giant updated its core accessibility tools like VoiceOver, Magnifier, Voice Control, and Accessibility Reader with new features, alongside new AI-generated subtitles for videos without captions. Apple Vision Pro users can access eye-tracking-based wheelchair controls, while accessibility support across iPhone, iPad, Mac, Apple TV, and visionOS has also been expanded. New AI-Powered Accessibility Features In a blog post, Apple said that its latest accessibility features are powered by Apple Intelligence. They are designed to improve how users interact with Apple devices using voice, vision, motion, and language-based controls. Apple Intelligence expands VoiceOver's existing capabilities with a new Image Explorer option. The company says it can provide more detailed descriptions of photos, scanned bills, documents, and visual content. The feature is accessible via the Action button on supported iPhone models, where users can ask questions about what appears in the camera's viewfinder and receive contextual spoken responses. Magnifier is also receiving AI-powered exploration features. It will deliver spoken visual descriptions in a high-contrast interface, along with the ability to control Magnifier using voice commands such as "zoom in" or "turn on flashlight." Separately, Apple is also upgrading Voice Control with more natural language understanding. The company claims users with physical disabilities can interact with apps by describing interface elements conversationally instead of having to memorise exact labels. The updated Accessibility Reader, meanwhile, supports complex layouts, including scientific papers, tables, and multi-column documents. Apple also announced AI-generated subtitles for videos that do not already include captions. Spoken dialogue in videos, online streams, and shared clips can be transcribed automatically across iPhone, iPad, Mac, Apple TV, and Vision Pro. This feature uses on-device speech recognition, and users can customise the generated subtitles using playback settings. For Vision Pro users, there is a new power wheelchair control feature. It uses the mixed reality headset's eye-tracking system to control compatible alternative drive systems, as per Apple. The feature will initially support Tolt and LUCI wheelchair systems in the US using Bluetooth or wired accessory connections. Other smaller accessibility improvements include Vehicle Motion Cues, face gestures, and enhanced Dwell Control eye-selection features for Vision Pro. tvOS gains larger text support, while the company is also bringing expanded Name Recognition language support, improved Made for iPhone hearing aid connectivity, and support for the Sony Access Controller on iPhone, iPad, and Mac. In addition to software features, Apple said that the Hikawa Grip & Stand for iPhone is now available globally through the Apple Store online in three new colour options. The accessory was developed by designer Bailey Hikawa in collaboration with users with disabilities affecting grip strength and mobility.

Apple Intelligence finally has a genuinely helpful use case with new accessibility features

Apple is boosting VoiceOver, Magnifier, Voice Control, and Accessibility Reader with AI, while Vision Pro can now steer a wheelchair Apple has announced new accessibility features that use Apple Intelligence AI to make life a little easier for people with vision, hearing and physical difficulties. The new features, which will arrive as part of iOS 27 later this year, centre around the existing VoiceOver, Magnifier, Voice Control, and Accessibility Reader. Furthermore, Apple has announced its Vision Pro headset can be used to steer a powered wheelchair using their eyes. This option is designed with people who aren't able to steer with a joystick. "Leveraging the precision eye-tracking system on Apple Vision Pro, a new power wheelchair control feature offers users a responsive input method for compatible alternative drive systems," Apple says in a press release. "With Vision Pro, eye tracking doesn't require frequent recalibration and works in a variety of lighting conditions." The update for Magnifier can pull key information from something like a utility bill and present the key information in a larger, more readable font. It offers an assistive exploration and visual description in a high-contrast interface. You may see information like the amount and the due date highlighted and you can ask any questions. Voice Over gets a similar feature, enabling Apple to describe photographs, personal records and other visual content. Both can be accessed via a shortcut using the Action Button. The company is also adding generated subtitles for video that'll add captions to videos shared by friends and family. The company added: "With new generated subtitles, videos can display transcriptions of spoken audio automatically when captions or subtitles are not already provided, including in clips recorded on iPhone, received from friends and family, or streamed online." Apple is also giving Voice Control a natural language overhaul, thanks to Apple Intelligence. "With Apple Intelligence, Voice Control becomes more intuitive than ever, using natural language to help users with a range of physical disabilities navigate iPhone and iPad entirely by voice," Apple says. "With a new flexible input, users can describe onscreen buttons and controls with natural language instead of memorising exact labels or numbers. The option to "say what you see" is great for navigating any app, including those with visual layouts such as Apple Maps or Files, using intuitive language like "tap the guide about best restaurants" or "tap the purple folder."

Apple Just Dropped a Surprise iOS 27 Preview -- And It Changes How We Use Siri Forever

Apple has unveiled some of its AI-driven features coming in iOS 27, emphasizing a user-first approach to artificial intelligence. By focusing on empowerment, independence, and privacy, Apple demonstrates how AI can seamlessly enhance everyday technology. These updates are not about flashy or experimental innovations but about embedding AI into tools that genuinely improve usability and accessibility for all users. The video below from 9 to 5 Mac gives us more details on what Apple has planned. Apple's latest updates underscore the fantastic potential of AI to address the needs of individuals with disabilities. These features are designed to empower users by making technology more inclusive and accessible: By integrating these features directly into its ecosystem, Apple reinforces its commitment to accessibility as a fundamental design principle, making sure that technology serves everyone equally. Apple's AI advancements extend beyond accessibility, redefining how users interact with their devices. Voice-controlled navigation now supports natural language commands, allowing you to perform tasks without memorizing specific phrases. For example, you can ask your device to "show photos from last weekend," "open my latest email," or "turn on the living room lights," making interactions more intuitive and efficient. Additionally, context-aware actions anticipate your needs based on your habits and preferences. Whether it's suggesting frequently used apps during your morning routine, adjusting settings when you arrive at work, or recommending playlists during workouts, Apple's AI works quietly in the background to simplify your daily life. These enhancements demonstrate how AI can make technology more responsive and personalized without requiring constant user input. The Vision Pro headset introduces advanced accessibility features that redefine how individuals with limited mobility interact with technology. One of the standout innovations is its eye-tracking technology, which allows users to control devices using only their gaze and blinks. This feature is particularly beneficial for individuals with physical disabilities, offering them a new level of independence. For wheelchair users, Vision Pro extends its capabilities to eye-controlled navigation, allowing seamless interaction with digital environments. By using the headset's advanced sensors and AI capabilities, Apple provides tools that break down barriers and empower users to engage with technology in ways that were previously unimaginable. These advancements highlight Apple's dedication to inclusive design and its commitment to creating technology that serves diverse needs. In an era where data privacy is a growing concern, Apple's approach to AI stands out for its emphasis on security. All AI processing in iOS 27 occurs on-device, making sure that sensitive user data remains private and is not shared with external servers. This privacy-centric design aligns with Apple's broader commitment to protecting user information. By embedding AI directly into its operating systems, Apple eliminates the need for cloud-based processing, enhancing both privacy and performance. Tasks such as voice recognition, image processing and context-aware actions are executed locally, resulting in faster, more reliable functionality. This approach not only safeguards user data but also ensures that AI features remain responsive and dependable. Apple's integration of AI technologies reflects a deliberate focus on practical and impactful use cases. Unlike competitors who often emphasize experimental or standalone AI applications, Apple embeds AI into tools that users already rely on. This approach avoids the hype surrounding attention-grabbing innovations like chatbots, instead prioritizing features that genuinely enhance user experiences. By integrating AI into its ecosystem, Apple ensures that the technology complements existing functionalities rather than overwhelming users with unnecessary complexity. This strategy highlights Apple's commitment to meaningful innovation, where the goal is not to showcase AI's potential but to use it to make everyday life better. The emphasis on usability and practicality sets Apple apart as a leader in thoughtful and user-centric design. Apple's AI-driven features in iOS 27 establish a benchmark for responsible and thoughtful integration of artificial intelligence. By focusing on accessibility, natural language interaction, and privacy, Apple demonstrates how AI can empower users without compromising security or usability. Through deliberate and user-focused innovation, Apple provides a model for how technology companies can integrate AI meaningfully. These advancements are not about following trends but about creating tools that enhance lives in practical and impactful ways. By embedding AI into its ecosystem with a focus on inclusivity and privacy, Apple reaffirms its position as a leader in responsible and purposeful design. Expand your understanding of iOS 27 with additional resources from our extensive library of articles. Disclosure: Some of our articles include affiliate links. If you buy something through one of these links, Geeky Gadgets may earn an affiliate commission. Learn about our Disclosure Policy.

Apple Unveils AI Push Beyond Siri With Smart Writing, Accessibility Features - Apple (NASDAQ:AAPL), Alpha

The company said the new features will arrive later this year and focus on navigation, visual assistance and communication tools. Apple also introduced AI-driven subtitle generation, enhanced Voice Control functions and new wheelchair controls for Vision Pro users. Apple also confirmed its Worldwide Developers Conference will run from June 8 through June 12, 2026, where investors may expect major software and Apple Intelligence updates. In fact, Apple is reportedly preparing new AI-powered writing tools, wallpaper generation features and smarter Shortcuts capabilities for iOS 27 ahead of WWDC 2026, according to a Bloomberg report. The update could also introduce natural language shortcut creation and Grammarly-style writing assistance across Apple devices. AI Expands Accessibility Tools Apple said VoiceOver will soon deliver richer image descriptions across apps and documents using Apple Intelligence. Users can also ask follow-up questions about objects viewed through the iPhone camera. Magnifier received similar upgrades for visually impaired users. The feature now supports spoken commands like "zoom in" and "turn on flashlight." The company also upgraded Voice Control with conversational navigation support. Users can interact with apps using natural phrases instead of memorizing exact button labels. Apple said the feature could improve accessibility across visually complex apps, including Maps and Files. New Reading And Subtitle Features Accessibility Reader now supports dense layouts containing tables, graphics and multiple text columns. Apple also added article summaries and built-in translation tools. The company introduced automatic subtitle generation for videos lacking captions. The feature works across iPhone, iPad, Mac, Apple TV and Vision Pro. Apple said on-device speech recognition handles subtitle creation privately without cloud processing. Vision Pro Wheelchair Controls Apple also announced eye-tracking controls for compatible power wheelchairs using Apple Vision Pro. The system supports TOLT Technologies and LUCI alternative drive systems in the United States. Users can connect through Bluetooth or wired accessories. Pat Dolan, founder of GeoALS, praised the development for improving independence among wheelchair users. "The option to control my power wheelchair on my own is gold to me," Dolan said. Additional Ecosystem Updates Apple also expanded support for hearing aids, sign-language interpretation apps and Sony Access gaming controllers. The company said tvOS will support larger text settings, while Name Recognition now works across more than 50 languages. AAPL Price Action: Apple shares were down 0.16% at $297.37 at the time of publication on Tuesday. The stock is approaching its 52-week high of $303.20, according to Benzinga Pro data. Photo by Tada Images via Shutterstock This content was partially produced with the help of AI tools and was reviewed and published by Benzinga editors. Market News and Data brought to you by Benzinga APIs To add Benzinga News as your preferred source on Google, click here.

Apple Just Confirmed These New iOS 27 Features

Apple's iOS 27, a major update that emphasizes accessibility and user-centric design, is coming at WWDC 2026 next month. This release introduces a range of features powered by advanced Apple Intelligence, integrating technologies such as natural language processing, eye-tracking, and AI-driven tools. These innovations aim to make Apple devices more inclusive and adaptable to diverse user needs. The developer beta will be available starting June 8, 2024, during WWDC, offering developers and early adopters a glimpse into the future of Apple's ecosystem. The video below from iDeviceHelp gives us more details on what Apple has planned for iOS 27. iOS 27 introduces significant advancements in natural language processing (NLP), transforming how users interact with their devices. For individuals with disabilities, these features make navigation and communication more intuitive. Voice controls now allow you to describe on-screen elements to perform actions. For example, you can say, "Open the menu at the top right," and the system will execute the command without requiring precise gestures. This functionality is particularly helpful for users with motor impairments. The Magnifier app has also been upgraded to use NLP capabilities. It can now answer natural language questions about on-screen content, providing detailed descriptions of both digital interfaces and physical surroundings. This enhancement is especially beneficial for visually impaired users, allowing them to better understand and interact with their environment. To address the needs of users with hearing impairments, iOS 27 introduces automatic subtitle generation for video content. This feature ensures that you can access videos without relying on third-party tools, making media consumption more seamless and inclusive. The subtitles are generated in real time, maintaining accuracy and synchronization with the audio. Apple has also developed a new API that allows developers to integrate real-time sign language interpreters into FaceTime calls. This new feature enables a sign language interpreter to appear during video calls, facilitating smooth communication for the deaf and hard-of-hearing community. Whether you're participating in a personal conversation or a professional meeting, this tool ensures that everyone can engage fully. The Apple Vision Pro receives substantial updates in iOS 27, further enhancing its accessibility features. One of the most notable advancements is the integration of eye-tracking technology, which allows users with limited mobility to control devices and navigate environments with precision. For individuals using powered wheelchairs, this feature provides a new level of independence and control. Additional improvements include enhanced vehicle motion cues and touch accommodations, making sure that the Vision Pro adapts to a wide range of user needs. These updates make the device more versatile and capable of supporting users in various scenarios, from navigating complex spaces to interacting with digital content. Apple continues to refine its support for Made for iPhone hearing aids, streamlining the setup process to make configuration easier and more efficient. This ensures that users can quickly connect their hearing aids and enjoy a seamless audio experience across Apple devices. For users who require larger text, iOS 27 expands text enlargement options across the Apple ecosystem, including Apple TV and tvOS 27. This enhancement ensures that content remains accessible and easy to read, regardless of the device or screen size. By prioritizing readability, Apple makes its products more inclusive for users with visual impairments or other accessibility needs. At the core of iOS 27's advancements is AI-driven innovation, which powers many of the new accessibility features. From natural language processing to automatic subtitles, Apple Intelligence enables devices to adapt to individual needs with remarkable precision. These AI-driven tools not only improve usability but also set a new standard for how technology can foster inclusivity. By using AI, Apple ensures that its devices are not only smarter but also more empathetic to the diverse requirements of its users. iOS 27 represents a significant leap forward in accessibility and user-focused design. By integrating technologies like natural language processing, eye-tracking, and AI, Apple continues to prioritize inclusivity across its ecosystem. Whether you rely on voice controls, real-time sign language support, or enhanced hearing aid compatibility, iOS 27 ensures that technology adapts to your unique needs. With the developer beta launching at WWDC 2024, these features are poised to redefine how users interact with their devices. By making technology more accessible and adaptable, Apple reaffirms its commitment to creating a digital experience that is inclusive for everyone. Take a look at other insightful guides from our broad collection that might capture your interest in iOS 27 Features. Disclosure: Some of our articles include affiliate links. If you buy something through one of these links, Geeky Gadgets may earn an affiliate commission. Learn about our Disclosure Policy.

Apple previews AI-powered accessibility features for 2026 By Investing.com

CUPERTINO, Calif. - Apple Inc. (NASDAQ:AAPL) announced a series of accessibility updates on Tuesday that incorporate Apple Intelligence into features including VoiceOver, Magnifier, Voice Control, and Accessibility Reader, according to a press release statement.The announcement comes as Apple maintains its position as the world's most valuable technology company with a market capitalization of $4.37 trillion. The stock trades at $297.84, just shy of its 52-week high of $303.20, delivering a strong 43% return over the past year. According to InvestingPro analysis, the stock currently appears overvalued relative to its Fair Value -- placing it among companies on the most overvalued list. The updates will enable VoiceOver's Image Explorer to provide detailed descriptions of images across the system, including photographs, scanned bills, and personal records. Users can press the Action button on iPhone to ask questions about what appears in the camera viewfinder and receive detailed responses. Magnifier will use Apple Intelligence to provide visual descriptions through a high-contrast interface designed for users with low vision. The feature will allow users to control the app with spoken requests such as "zoom in" or "turn on flashlight." Voice Control will support natural language input, allowing users to describe onscreen buttons and controls without memorizing exact labels or numbers. The feature will be available in English in the U.S., Canada, the UK, and Australia.Apple's innovation push comes amid strong analyst confidence, with InvestingPro Tips revealing that 26 analysts have revised their earnings upwards for the upcoming period. The company also boasts a perfect Piotroski Score of 9, indicating exceptional financial health. These are just 2 of the 18+ exclusive ProTips available to subscribers, alongside comprehensive Pro Research Reports that transform complex financial data into actionable intelligence for over 1,400 US equities. Accessibility Reader will handle more complex source material including scientific articles with multiple columns, images, and tables. The feature will include on-demand summaries and built-in translation. Apple announced generated subtitles for video content without existing captions across iPhone, iPad, Mac, Apple TV, and Apple Vision Pro. The subtitles will be generated using on-device speech recognition and will be available in English in the U.S. and Canada. Apple Vision Pro will support a power wheelchair control feature using eye-tracking technology. The feature will be compatible with TOLT Technologies and LUCI alternative drive systems in the U.S., supporting both Bluetooth and wired connections. The Hikawa Grip & Stand for iPhone, an adaptive MagSafe accessory, became available today in three new colors on the Apple Store online in 20 countries. The accessibility features and Apple Intelligence updates will be released later this year. Apple Intelligence is available in beta with support for 18 languages.For investors seeking deeper insights into Apple's financial performance and valuation metrics, the company's comprehensive Pro Research Report offers intuitive visuals and expert analysis covering everything from the company's 47.86% gross profit margin to its revenue growth trajectory. In other recent news, Apple Inc. has been the focus of several noteworthy developments. Evercore ISI raised its price target for Apple to $365, citing growth in its services sector. This comes as the firm maintains an Outperform rating on the stock, projecting mid to high single-digit revenue growth and low to mid-teens earnings per share and free cash flow growth. Meanwhile, Apple plans to introduce a customizable Camera app in its upcoming iOS 27 update, allowing users to tailor features such as flash, exposure, timer, and resolution. Additionally, Apple and Google have collaborated to roll out end-to-end encryption for Rich Communication Services messaging, enhancing security for chats between Android and iPhone users. Security researchers at Calif have identified a method to bypass Apple's security technology using Anthropic's Mythos AI software, revealing vulnerabilities in Mac devices. In related news, Varta, a supplier for Apple, announced it will cut 350 jobs and halt button cell production after losing its largest client. These recent developments highlight a mix of strategic advancements and challenges for Apple. This article was generated with the support of AI and reviewed by an editor. For more information see our T&C.

Apple announces new AI-powered accessibility features ahead of WWDC 2026: All details

Just recently, Apple confirmed the dates for this year's WWDC aka Worldwide Developers Conference. The Cupertino based tech giant will be hosting the conference from June 8 - 12 this year. And now, ahead of the much-awaited event, the company has just announced a number of accessibility features coming across the iPhone, iPad, Mac, Apple TV, and Vision Pro ecosystem later this year. Apple also says that many of these updates are powered by Apple Intelligence, its on-device AI system that focuses heavily on privacy and personalisation. Accessibility has long been one of Apple's strongest focus areas, and these announcements look like they are trying to show how AI is now being integrated into everyday assistive tools instead of existing as a separate feature. From more intelligent VoiceOver controls to automatically generated subtitles for videos, Apple is clearly positioning AI as a way to make its devices easier to use for everyone. Let's take a closer look at all the features that have been announced. Also read: Google I/O 2026: Gemini 3.5 to AI smart glasses, everything that was announced Apple started off with a feature for those who are blind or have limited vision. VoiceOver and Magnifier just got AI superpowers, thanks to Apple Intelligence. The new Image Explorer feature lets VoiceOver provide much more detailed descriptions of images, documents, bills, and photos across the system. Users can also ask follow-up questions in natural language to get additional context about what is visible on screen or through the camera viewfinder. As for Magnifier, it is becoming more conversational. Users will be able to ask spoken questions, zoom in using voice commands, or activate tools like the flashlight hands-free. Apple says these features are designed to work with the iPhone's Action button for quicker access. Another important AI-powered upgrade has been added to Voice Control. Now, instead of memorising exact button names or interface labels, users need to just describe what they see on screen in natural language. For example, someone could say "tap the purple folder" or "open the guide about best restaurants," and the system would understand the request. Apple says this should especially help users navigate apps that may not have been properly optimised for accessibility. For users with dyslexia or other reading disabilities, there are upgrades to the Accessibility Reader. The updated version can now better handle complex layouts such as scientific articles with multiple columns, images, and tables. In addition to this, users will also be able to generate AI-powered summaries before reading a long article. And this isn't all, built-in translation support is also being added, allowing text to appear in a user's preferred language while preserving formatting and styling. Another big announcement is automatically generated subtitles for videos that do not already include captions. Apple says the feature will work for personal videos, clips shared by friends and family, and even online streams. Subtitles are generated directly on-device using speech recognition, which means the process stays private. The feature is coming to iPhone, iPad, Mac, Apple TV, and Vision Pro. The Apple Vision Pro is a futuristic gadget, there is no doubt about that. And that too has been updated with a feature that can be a game changer for those on wheelchairs. Well, compatible wheelchairs. Apple says users with compatible alternative wheelchair drive systems will be able to control power wheelchairs using Vision Pro's eye-tracking technology. The company claims the headset's eye tracking works reliably in different lighting conditions and does not require frequent recalibration. Initial support will include Tolt and LUCI drive systems in the US. Pat Dolan, founder of GeoALS and a member of Team Gleason's advisory board, described the feature as "life-enhancing technology" for users who depend on power wheelchairs. Alongside the software updates, Apple also announced wider availability for the Hikawa Grip & Stand accessory for iPhone. Designed with accessibility in mind, the MagSafe accessory was created in collaboration with people with disabilities affecting grip, mobility, and strength. It is now launching globally in three new colours through the Apple Store. Apple is expected to share more AI-focused announcements during WWDC next month. Keep watching this space for more such updates.