Apple has revealed new accessibility enhancements utilizing Apple Intelligence ahead of its developer conference, improving features such as VoiceOver and real-time captioning for videos. Notably, users of the Vision Pro headset will be able to operate compatible wheelchairs using eye movement, a significant advancement for mobility.
Among the updates, the VoiceOver feature has been enhanced to provide more detailed descriptions of images, including reading details from bills, such as amounts and due dates. The Live Recognition capability allows users to activate it via an iPhone camera to identify objects and ask follow-up questions.
Other features include the ability to issue voice commands for various actions, such as “zoom in” or “turn on flashlight,” as well as improved functionality in the Reader app, which now supports complex documents and can offer AI-generated summaries. Additionally, videos recorded on Apple devices can have AI-generated subtitles, making content more accessible across all devices.