Apple expands accessibility with new AI-powered features
▼ Summary
– Apple’s annual accessibility update adds features for iPhone, Mac, and Vision Pro, using on-device AI for VoiceOver, Magnifier, Voice Control, and Accessibility Reader.
– A new on-device speech recognition feature for uncaptioned videos will be available on iPhone, iPad, Mac, Apple TV, and Vision Pro.
– AI enhancements include more detailed image descriptions in VoiceOver’s Image Explorer and natural language navigation for Voice Control.
– The MagSafe-compatible Hikawa Grip & Stand is now available worldwide via the Apple Store in three colors.
– Vision Pro gains eye-tracking integration with power wheelchair drive systems and Vehicle Motion Cues to reduce motion sickness.
Apple is rolling out a fresh wave of accessibility features across its devices, with a strong emphasis on on-device AI processing. The annual update covers the iPhone, Mac, and notably the Apple Vision Pro, introducing tools like enhanced VoiceOver, Magnifier, Voice Control, and the new Accessibility Reader.
One standout addition is the ability to use on-device speech recognition for videos that lack captions. This feature will be available on iPhone, iPad, Mac, Apple TV, and Apple Vision Pro.
Later this year, other AI-driven changes will arrive. Image Explorer within VoiceOver will gain richer, more detailed descriptions of images, though Apple warns users not to rely on these in risky or dangerous scenarios. Users will also be able to press the Action button to ask questions about what the camera sees. The Voice Control system is getting natural language navigation, and the Accessibility Reader will soon summarize complex material more effectively.
On the non-AI front, Apple is making the MagSafe-compatible Hikawa Grip & Stand available worldwide through the Apple Store starting today, offered in three colors.
For the Vision Pro, Apple is linking its eye-tracking system to power wheelchair drive systems, including compatibility with Tolt and LUCI in the US. Users can connect via Bluetooth or hardwire through the Developer Strap. The headset is also gaining Vehicle Motion Cues to help reduce motion sickness when worn in a moving vehicle. Additional updates include Larger Text support on tvOS and a new API that brings sign language interpreters into FaceTime calls, all detailed in the full press release.
(Source: The Verge)
