Apple is finally upgrading Siri with true chatbot capabilities by leveraging Gemini to close the gap with rival AIs. The digital assistant will get a new dedicated app across iOS, iPadOS, and macOS, allowing more conversational interactions. Siri will emerge from the Dynamic Island when summoned, with users able to swipe down to access voice or text queries through a new search interface.

Siri will gain visual intelligence by accessing device cameras and screen content to identify objects, estimate calories, and analyze receipts for bill splitting. The assistant will even work with Apple Vision Pro to estimate product sizes. In macOS, Siri receives a dedicated keyboard shortcut for contextual functions like adding calendar events or performing image searches based on user selections.

Apple introduces new writing tools that let Siri generate drafts based on prompts, proofread documents, and adjust responses based on the recipient. The new Siri app will launch first in the US later this year before expanding to Europe and China. Users will see previous queries and chats synced across devices via iCloud, with detailed text cards and multimedia responses in the standalone app.