Apple rolled out the next phase of its Visual Intelligence platform during the WWDC keynote, introducing a Siri mode inside the iPhone Camera app. Vice president of software engineering Sebastien Marineau‑Mes explained that the feature leverages Apple’s foundational models to interpret what the lens sees and surface context‑aware actions, turning a simple snapshot into an interactive tool. Developers can already access the APIs through the new iOS 18 beta.

The new mode immediately shows its consumer payoff. Point the camera at a restaurant receipt and the app calculates each person’s share, then pushes the total through Apple Cash so friends can settle the tab instantly. A quick scan of a plate returns calorie counts and macronutrient breakdowns, turning everyday meals into data‑rich moments without leaving the Camera view.

Apple also announced that Visual Intelligence will be ported to visionOS, extending object recognition to the spatial computing environment of Vision Pro. Siri can identify items in a user’s surroundings and surface relevant information on demand, blurring the line between digital assistants and the physical world. The rollout makes AI‑driven context a core part of Apple’s hardware ecosystem today.