HeadlinesBriefing favicon HeadlinesBriefing.com

visionOS 27 adds Gemini-powered Siri with gaze tracking to Vision Pro

Engadget •
×

Apple's visionOS 27 introduces a Gemini-powered Siri that tracks your gaze and uses Visual Intelligence to answer questions about what you're viewing. The assistant responds to its floating icon without requiring "Hey Siri" activation, and can combine world knowledge with personal context for complex queries.

During WWDC 2026, Apple demonstrated how Siri could analyze a backpack in Safari to determine carry-on eligibility, then answer follow-up questions about fitting hiking boots inside. The assistant also drafts or edits text anywhere you type, with customizable voice settings for pitch, speed, and tone.

Beyond Siri, visionOS 27 converts panoramic photos into spatial scenes with depth for immersive environments. Notifications expand when you look at them, and app windows now support curvature for more natural viewing experiences. Designers can preview and edit 3D models from their Mac directly in physical space.

Despite Vision Pro's limited market presence, Apple continues investing in the $3,500 headset's software foundation. These updates likely prepare the platform for rumored Apple glasses, ensuring the ecosystem matures before next-generation hardware arrives.