Google has added computer use to Gemini for Mac. Give it a multi-step task and it can click, type and work across approved apps in a background window while you carry on using your Mac.

For businesses, that points to a new way of handling repetitive work that crosses several systems. The immediate question is which steps are predictable enough to delegate and where a person should check the result.

Read Google’s 19 November announcement

Availability at launch

US only, in English. Eligible Google AI Plus, Pro or Ultra subscribers aged 18+ using a personal Google Account and an Apple Silicon Mac with macOS Sequoia 15 or later.

Google’s eligibility and setup guide

Header image: AI-generated editorial illustration for ADJ Systems.

See Gemini work across an app

In Google’s launch demo, Gemini takes a child’s butterfly sketch and builds and rigs a 3D model in Blender. The demo shows how Google wants the feature to work inside a desktop app. Your own workflow would need its own test.

Video: Google. Gemini models and rigs a butterfly in Blender. Watch on Google’s announcement page.

How computer use changes the workflow

A chatbot can tell you how to complete a task. With computer use, Gemini can also take the steps in the apps you’ve allowed. Google puts those actions in a background window and shows a live preview in the chat. You can stop the task and confirm sensitive actions when prompted.

An example with a human review step

Imagine processing a receipt across a downloads folder and an expense tool. Here’s how a small pilot could divide the work.

1. Define the task

Ask the agent to extract the supplier, date and amount and prepare an expense entry.

2. Watch it work

Give it access to the folder and expense tool. Follow the live preview as it fills the fields.

3. Check and submit

Compare the entry with the receipt. A person corrects any errors and submits it.

Workflow diagram: ADJ Systems. Setup and controls are described in Gemini Apps Help.

Where businesses could use it

Look for work that repeatedly moves information between approved tools. These are examples of workflows a business could test when suitable tools are available.

Customer enquiries

Group incoming requests, flag missing details and prepare a CRM update and draft response for a staff member to check.

Management reporting

Collect figures from approved dashboards and build a draft weekly report. Check the figures against the source before circulation.

Content operations

Move approved copy and media credits into a CMS draft. Keep layout review and publication with the editor.

What still needs a person

When an agent enters data or changes a record, a wrong field or recipient can affect customers and colleagues. Start with sample data, restrict access to the apps the task needs and keep approvals in place for sending messages, updating live records or making payments. A live preview helps you follow the work. Check the final result against the source before it goes further.

What New Zealand businesses can do now

As of this test article, Google lists the United States for this rollout. In the meantime, choose one recurring task, write down its inputs and approval points, and time how long it takes today. Include exception handling and checking time in that baseline.

If your tools already have a reliable integration, use it for predictable transfers. An agent may help with steps that still need someone to navigate an interface. A useful pilot will show whether the whole task takes less staff time once review is included.

Sources