HeadlinesBriefing favicon HeadlinesBriefing.com

Apple Intelligence Powers New Accessibility Features Including Eye-Tracking Wheelchair Control

Hacker News •
×

Apple previewed a suite of accessibility updates powered by Apple Intelligence that enhance core tools like VoiceOver, Magnifier, Voice Control, and Accessibility Reader. These features will launch later this year with more detailed image descriptions and natural language navigation capabilities across iOS and macOS platforms.

VoiceOver's Image Explorer now provides detailed descriptions of photographs, bills, and personal documents using Apple Intelligence. The Magnifier app gains high-contrast visual descriptions, while Voice Control accepts natural language commands like "tap the purple folder" instead of memorized labels. Accessibility Reader handles complex layouts including scientific articles with multiple columns and tables.

A standout feature enables Apple Vision Pro users to control compatible power wheelchairs using precision eye-tracking, launching with Tolt and LUCI drive systems. On-device subtitle generation automatically transcribes spoken dialogue in videos across the Apple ecosystem without requiring internet connectivity.

Tim Cook emphasized Apple's privacy-first approach, with all processing happening locally on devices. The eye-tracking wheelchair feature addresses a critical need for users who cannot operate traditional joysticks, representing a significant advancement in assistive technology integration.