New accessibility updates add on-device AI processing across iPhone, Mac, Apple TV, and Apple Vision Pro. VoiceOver, Magnifier, Voice Control, and Accessibility Reader gain improvements that rely on local processing. Speech recognition will enable captions for uncaptioned videos on multiple Apple devices. Later updates will enhance VoiceOver’s Image Explorer with more detailed image descriptions, while warning against relying on those descriptions in risky or dangerous situations. Voice Control will support natural language navigation. Accessibility Reader will summarize more complex material. Vision Pro will link eye tracking to power wheelchair drive systems, add vehicle motion cues to reduce motion sickness, and support additional connection options for assistive hardware.
"One addition that jumped out to me is the ability to use on-device speech recognition for uncaptioned videos, which will be available on iPhone, iPad, Mac, Apple TV, and Apple Vision Pro."
"Other changes coming later this year will use AI to add more details to VoiceOver's Image Explorer in descriptions of images (with a warning that they should not be relied on in any number of risky or potentially dangerous situations), and the ability to ask questions about what the camera sees by pressing the Action button."
"It's also adding natural language navigation to the Voice Control system, and the Accessibility Reader will be ready to summarize more complex material."
"The Vision Pro will be able to link its eye-tracking system to power wheelchair drive systems, including Tolt and LUCI in the US, and have support for connecting via Bluetooth or hardwired with the Developer Strap. It's also getting Vehicle Motion Cues to reduce motion sickness for anyone putting on Apple's $3,499 headset in a moving vehicle."
Read at The Verge
Unable to calculate read time
Collection
[
|
...
]