Apple just gave us a massive preview of what is coming to its software platforms later this year, and it is all about making its devices more accessible using AI. These major updates dropped just weeks before Apple kicks off its annual Worldwide Developers Conference (WWDC) next month, giving us an early look at how the company plans to weave Apple Intelligence into daily life.
“Apple’s approach to accessibility is unlike any other,” said Tim Cook, Apple’s CEO, in a statement on Tuesday. “Now, with Apple Intelligence, we are bringing powerful new capabilities into our accessibility features while maintaining our foundational commitment to privacy by design.”
Here is a full breakdown of the new features and tools Apple just announced, ahead of WWDC, as this saves the company from taking up even more time at its opening keynote, which will likely focus on Apple Intelligence and the new AI Siri.
For users who are blind or have low vision, VoiceOver is getting a significant boost. A new tool called Image Explorer uses Apple Intelligence to serve up highly detailed descriptions of visual content across the system. This means it can describe everything from standard family photos to scanned utility bills and personal documents.
Even better, the Live Recognition feature is teaming up with the Action button on the iPhone. Users can press the button to ask a question about whatever the camera is pointing at and get an instant, detailed answer. You can even ask natural follow-up questions to get more specific visual information about your surroundings.
Magnifier is getting a similar treatment. It brings the same AI exploration and visual descriptions into a high-contrast interface designed specifically for low-vision users. This app also integrates with the Action button for quick Q&As, and you can now control the app entirely using basic spoken commands like “zoom in” or “turn on flashlight.”
Navigating an iPhone or iPad by voice is about to get a lot smoother for individuals with physical disabilities. Thanks to Apple Intelligence, Voice Control will now understand natural language. Instead of being forced to memorize exact on-screen labels or numbers, users can literally just say what they see.
This flexible input lets you navigate complex apps with visual layouts, like Apple Maps or Files, by using everyday phrases. For instance, you can say “tap the guide about best restaurants” or “tap the purple folder.” It is a massive win for usability, especially when developers forget to properly label on-screen elements for accessibility.
The Accessibility Reader, which helps users with everything from dyslexia to low vision, is getting a major upgrade to handle complicated source material. The tool can now reformat complex documents like scientific articles, neatly organizing multi-column text, tables, and images into a clean, easy-to-read layout.
Apple is also adding on-demand summaries so readers can grab a quick overview of an article before digging into the full piece. Plus, a new built-in translation feature lets users read text in their native language while keeping their custom fonts, sizes, and colour choices intact.
While commercial movies usually have subtitles, personal media often gets left in the dark. Apple is fixing this by introducing on-device generated subtitles for uncaptioned video content.
Whether it is a video clip you recorded on your iPhone, a clip sent by a friend, or something streamed online, your device can automatically transcribe the spoken audio. Because this relies entirely on on-device speech recognition, the process remains private. The feature will work across iPhone, iPad, Mac, Apple TV, and Apple Vision Pro, and you can customize how the text looks in your settings.
Apple is also leveraging the precision eye-tracking system on the Apple Vision Pro to let users control compatible power wheelchairs. For people who cannot operate a traditional joystick, this offers a highly responsive alternative drive control.
The system operates beautifully in various lighting conditions and does not require constant recalibration. Apple is launching this feature in the U.S. first alongside alternative drive systems from Tolt and LUCI, supporting both Bluetooth and wired setups. Canadians and others will have to wait on this integration.
Pat Dolan, founder of GeoALS and a member of Team Gleason’s patient advisory board, has lived with ALS for a decade. He stated that the option to control his power wheelchair on his own is gold to him, adding that Apple is developing life-enhancing technology for the people who need it most.
Apple packed a bunch of smaller updates into this preview, and the ability to increase text on Apple TV is going to be big for everyone (where are the better parental controls, Apple?):
On the hardware side, the Hikawa Grip & Stand for iPhone is officially available worldwide today on the online Apple Store ($79.95 CAD) in three new vibrant colours. Designed by Bailey Hikawa in collaboration with individuals facing mobility and grip challenges, the unique MagSafe accessory helps users hold their phones in whatever way works best for them. This global launch comes via a new partnership with PopSockets.
Want to see more of our stories on Google?
P.S. Want to keep this site truly independent? Support us by buying us a beer, treating us to a coffee, or shopping through Amazon here. Links in this post are affiliate links, so we earn a tiny commission at no charge to you. Thanks for supporting independent Canadian media!
