HeadlinesBriefing favicon HeadlinesBriefing.com

Raycast Screen Awareness: AI Context from Your Screen

9to5Mac •
×

Raycast has a new feature called Screen Awareness, which lets users bring context from their active app or window directly into AI Chat. Here are the details.\n\nRaycast AI can now work with what’s on your screen. Depending on how you use AI chatbots such as ChatGPT or Claude, there is a good chance you have to keep copying and pasting text, uploading screenshots, or explaining the context of what you are working on.

Raycast was recently updated with a feature that streamlines this workflow, giving Raycast AI direct access to the content of the focused window. The feature, called Screen Awareness, “brings context from your focused app or window into AI Chat or Quick AI, so you don’t have to copy text, attach screenshots, or explain what you’re looking at,” says Raycast.\n\nUse the Send Focused Window to AI command, choose Screen Awareness from the @ menu, or simply ask “summarise this” or “reply to this.” When activated, the context sent to Raycast AI can include app and window details, selected text, the focused control, and a screenshot of the focused window. On the Mac, it can also provide information about selected files or folders when triggered from Finder, while Raycast’s Browser Companion lets it pull in webpage details and content beyond what is currently visible onscreen.

According to the company, users can set up a hotkey to trigger Screen Awareness; Raycast says its team “likes to double-tap the right Command key.”\n\nHere’s the full set of new features included in Raycast v0.71: AI: Send Focused Window to AI command includes richer app and window context; AI: New Ask Screen Awareness AI Extension; AI: Added compaction and context management support; Quick AI: “Send Message” AI setting now respected; Dictation: Added import and new command; Hotkeys: Added support for chords using a modifier held on both sides of the keyboard.