Google is rolling out a new feature for Gemini users on macOS that allows them to interact with the AI chatbot by long-pressing the 'fn' key. This integration enables users to transcribe spoken words directly into their cursor, with Gemini automatically polishing the transcript by removing filler words like 'ums' and 'ahs'.\n\nFurthermore, if users enable Gemini's screen-aware reasoning, the AI can analyze what's on their screen and interact with open applications. This allows for tasks such as highlighting text in a PDF and asking Gemini to summarize it, or using notes to draft an email with the help of Gemini's Spark agentic AI.

Users can also direct Gemini to generate images based on vocal descriptions or content visible on their screen.\n\nThis feature follows the launch of the native Gemini app for macOS in April and the addition of the Spark agentic AI assistant in June. While currently limited to English, Google plans to introduce support for more languages later this year.