Claude Can Now Control Your Computer
In a post on X (formerly known as Twitter), the official handle of Claude announced the new feature. The company says now Claude can complete tasks on PCs autonomously. While the full details were not shared, the capability can be understood as an extension of the recently released Claude Dispatch feature, which lets users remotely control Claude on their computers.
Currently available as a research preview with Claude Code and Claude Cowork, the Computer Use feature can interact with desktop environments using a virtual mouse and keyboard, the ability to read screens via screenshots, and desktop automation via connected and legacy apps.
Some of the mentioned use cases of the feature include opening apps, navigating browsers, and working in productivity tools, such as spreadsheets, documents, and more. The company says initially, Claude will try to complete the task using connected apps, such as Slack, Calendar, and other integrated platforms. If there are no connected apps for the task, it will ask the user’s permission to open a legacy app directly on the screen.
Felix Rieseberg, Member of Technical Staff at Anthropic, highlighted that the feature will be useful when used with Dispatch, as it will not only let a user control Claude on a desktop from a mobile device, but also allow it to autonomously complete complicated tasks. However, he also warns that since it is a new technology’s early implementation, Claude, while Computer Use will be slower than a human today. Future iterations of the capability should be able to scale up the speed and the scope.
