Gemini app for Mac adds computer use to control desktop apps


Google is upgrading the Gemini app on Mac with computer use capabilities that can work across local desktop applications and the web.

The existing Task (previously Gemini Spark) functionality in the Mac app could just access local files in conjunction with Connected Apps, like @Gmail or @Google Calendar.

Computer use lets Gemini for Mac click and type on your behalf to accomplish multi-step tasks in local desktop apps and the web, like navigating menus and filling out forms. 

Gemini works in an “isolated background window with a live preview right in your chat,” while your main screen and cursor remain free to use. On the safety front, you can stop Gemini at any time with one click, while you choose what apps Gemini uses. Google will pause for logins and payments, with confirmation needed for sensitive actions.

Many everyday tasks span desktop apps and websites that don’t connect to each other. Computer use handles the tedious steps in the background so you can save time without giving up your screen or cursor.

Example use cases include:



To use, add @Computer use to your prompt. In Customize > Connectors, you’ll see new “Desktop” apps like Blender and Autodesk Fusion join the existing Git and Obsidian integrations.

Computer use is rolling out in US English starting today for Google AI Plus, Pro, and Ultra subscribers.

Add 9to5Google as a preferred source on Google Add 9to5Google as a preferred source on Google

FTC: We use income earning auto affiliate links. More.