A new AI feature can control your computer to follow your orders

An unseen, non-human hand moving the cursor across your computer screen and typing without using the keyboard in fiction is usually a sign of malicious AI hijacking something (or a friendly ghost helping you solve mysteries like the TV show Ghost Writer). Thanks to Anthropic’s new computer use feature for its AI assistant Claude, there’s a much more benevolent explanation now.

Fueled by an upgraded version of the Claude 3.5 Sonnet model, this AI – dubbed ‘computer use’ – lets you interact with your computer much like you would. It takes the AI assistant concept a step beyond text and a voice, with virtual hands typing, clicking, and otherwise manipulating your computer.

Anthropic bills computer use as a way for Claude to handle tedious tasks. It can help you fill out a form, search and organize information on your hard drive, and move information around. While OpenAI, Microsoft, and other developers have demonstrated similar ideas, Anthropic is the first to have a public feature, though it’s still in beta.

“With computer use, we’re trying something fundamentally new,” Anthropic explained in a blog post. Instead of making specific tools to help Claude complete individual tasks, we’re teaching it general computer skills—allowing it to use a wide range of standard tools and software programs designed for people.”

The computer use feature is due to Claude 3.5 Sonnet’s…