Apple expands Vision Pro’s capabilities with the release of visionOS 27, adding full‑blown controllers and object tracking. The update lets developers pair Bluetooth accessories that include LED constellations, IMUs, and optional haptics. By importing 3‑D models, the headset can now recognize and follow real‑world objects in real time for immersive applications today and future user.

visionOS 27 differentiates between spatial accessories and tracked objects. Spatial accessories, like a PSVR2‑style flashlight, require LED markers and an internal measurement unit to achieve high‑frequency, low‑latency tracking. Tracked objects, such as a globe or steering wheel, rely on 3‑D reference models or optional third‑party fobs to anchor them in the space for game development.

Apple’s move signals a shift toward tangible interaction in AR. By allowing developers to register physical items, the platform can surface contextual data—imagine a smart bottle displaying hydration stats or a plant pot revealing growth metrics. The framework also opens doors for racing simulators to overlay virtual vehicles onto real wheels for immersive experiences today.

While Vision Pro remains a niche headset, visionOS 27 lays groundwork for future AR glasses. The ability to track real‑world objects without custom hardware could lower entry barriers for accessory makers. Until the ecosystem matures, the biggest hurdle will be developer adoption, as the new features require significant coding effort to implement by developers today.