Anthropic just pushed its AI assistant Claude beyond chat, and onto your desktop.
In a new public beta feature called “Computer Use,” Claude can see what’s on your Mac screen and operate it like a person would: moving the cursor, clicking buttons, opening apps, typing into fields, and navigating the web. The pitch is simple: give Claude a task, walk away, and come back to work that’s already done.
The reality is messier. The tool is still experimental, limited to macOS, and appears tied to paid tiers like Claude Pro and Max, according to user reports. And once an AI can click “Send” or “Delete,” the big questions shift fast, from convenience to control, mistakes, and security.
Claude’s new “Computer Use” beta turns a chatbot into an on-screen operator
Sommaire
- 1 Claude’s new “Computer Use” beta turns a chatbot into an on-screen operator
- 2 What it can do: click, type, open apps, and fill out forms
- 3 “Dispatch” lets you kick off tasks from your phone, then let Claude drive your Mac
- 4 Why it’s powerful, and why it’s fragile
- 5 Anthropic warns users: don’t let Claude touch banking apps
- 6 What this signals for the next wave of AI
- 7 Key Takeaways
- 8 Frequently Asked Questions
- 9 Sources
Anthropic, the San Francisco-based AI company behind Claude, is rolling out “Computer Use” as a public beta through an API, aiming to learn quickly from real-world use, what works, what breaks, and where the risks are.
The key idea: instead of building a pile of narrow plugins for specific services, Anthropic wants Claude to develop “general computer skills” that work across everyday software designed for humans. That means interacting with the graphical interface itself, not tapping into some hidden backdoor of your apps.
Practically, that’s a major shift. Traditional assistants tell you what to do. This one does it, step by step, on your screen.
What it can do: click, type, open apps, and fill out forms
In the typical workflow, you type a request like “organize these files,” “prepare this report,” or “sort my email,” and Claude starts executing the actions required, opening applications, switching windows, copying and pasting text, and completing fields in web forms or spreadsheets.
One commonly cited use case is batch file work. Ask Claude to resize every photo in a folder, convert formats, and save them to a specific destination, and it will attempt to run the same sequence you’d do manually, without you babysitting every click.
Another sweet spot is the kind of tedious office work that eats hours: moving data between documents, filling out repetitive online forms, or populating spreadsheet cells. Text-only AI could draft a formula; it couldn’t reliably click into 10 different cells, check a column, and export the result. That’s the gap this feature is trying to close.
“Dispatch” lets you kick off tasks from your phone, then let Claude drive your Mac
The most attention-grabbing promise is remote execution. With a feature described as “Dispatch,” you can send a request from your smartphone and have Claude carry it out on your computer while you’re away.
Done right, it’s the productivity fantasy: start a document sort on the way to work, trigger a weekly report before a meeting, or run a morning email routine without writing scripts or setting up complicated automation rules. You just describe what you want in plain English.
But remote control also makes the practical constraints impossible to ignore. Your Mac has to be in the right state, awake, accessible, and not blocked by pop-ups, update prompts, or login screens. Early testers describe runs getting slowed or derailed by the kinds of interruptions every computer user knows too well.
Why it’s powerful, and why it’s fragile
Screen-driving agents are inherently brittle. They depend on what’s visible: where a button sits, whether a page loads quickly, whether a dialog box appears, whether a website redesign moved a menu. When any of that changes, the agent can stall, or worse, confidently click the wrong thing.
That doesn’t make the feature useless. For repetitive tasks, moving files, exporting reports, copying data, sorting inboxes, the time savings could be real. Companies spend billions on automation, and plenty of teams still limp along with macros and duct-taped scripts. Claude offers a new layer: automation by instruction.
The tradeoff is reliability. A traditional integration can be sturdy because it’s built for a specific system. A screen-based agent is more like a very fast intern working from visual cues, impressive when it works, frustrating when it doesn’t.
Anthropic warns users: don’t let Claude touch banking apps
Once an AI can operate your computer, the security stakes jump. Anthropic has explicitly advised against using the feature with banking applications, a blunt warning that underscores the risk of letting software take actions that can’t be easily undone.
The most obvious danger is irreversible misfires: sending an email to the wrong person, deleting the wrong folder, submitting the wrong form. Even small interface mistakes, like choosing the wrong option in a dropdown menu, can become serious in HR, finance, legal work, or any regulated environment.
There’s also the risk of deception. An agent navigating the web can encounter misleading pop-ups, fake download buttons, or permission prompts designed to trick users. A human might spot the scam. An AI focused on completing a goal might click straight through unless guardrails and confirmations are strong.
And then there’s data exposure. To do the job, the agent needs to “see” your screen and handle your documents, potentially including sensitive personal or corporate information. That’s a different level of trust than asking a chatbot for writing help.
What this signals for the next wave of AI
Anthropic’s move is part of a broader shift in AI: from systems that generate text to systems that take actions. If this approach works at scale, it could change how people interact with computers, less clicking and hunting through menus, more delegating outcomes.
But the beta status matters. The same feature that can save you an hour on busywork can also make a costly mistake in seconds. For now, the smartest use may be narrow and low-risk: repetitive tasks you can verify, in environments where a wrong click won’t become a real-world problem.
Key Takeaways
- Claude can now act directly on a computer, clicking and typing like a human
- The “Computer Use” feature is offered in beta, with access focused on macOS and paid plans
- Remote control via smartphone promises time savings, but reduces oversight
- Interface errors and complex tasks remain a weak point for agents
- Anthropic warns about security and advises against using it on banking apps
Frequently Asked Questions
Can Claude really take full control of a computer?
Yes. With the “Computer Use” feature, Claude can interact with the interface, move the mouse, click, type text, and open apps—like a user. This capability is still in beta, with limitations and possible errors depending on the interface.
Which platforms is the feature available on?
Available information indicates a beta release on macOS via the desktop app, with access mentioned for paid plans like Pro and Max. The goal is to test and improve it before any broader rollout.
Can you start a task from a smartphone?
Yes. A Dispatch-style feature lets you send requests remotely from a smartphone so Claude can then carry out the task on the computer. This mode is convenient for routines, but it assumes a stable environment and careful oversight of the actions taken.
What are the main risks of letting an AI click for you?
The biggest risk is an irreversible action caused by a misinterpretation—for example, accidentally sending or deleting something. There are also risks from deceptive web pages and unexpected pop-ups. Anthropic notably recommends avoiding banking apps.
Does this approach replace traditional connectors and integrations?
It complements them instead. Claude tries to use connectors first when they exist, then switches to direct computer control if needed. This flexibility expands what’s possible, but UI manipulation can be more fragile than a dedicated integration.
Sources
- L'IA Claude peut contrôler votre ordinateur pour travailler à votre place
- L'intelligence artificielle Claude peut désormais utiliser votre …
- Claude peut maintenant contrôler tout votre ordinateur – Presse-citron
- Claude AI peut désormais contrôler votre ordinateur – Les Numériques
- Claude peut maintenant utiliser votre ordinateur : r/ClaudeAI – Reddit



