Anthropic's Claude AI Takes a Leap Forward: Controlling Computers and Automating Tasks
43 Sources
[1]
Could Computer-Using Agents Be AI's Next Frontier? Anthropic Thinks So
The new feature reflects the evolution from AI that generates text to agents that perform actions. Artificial Intelligence has made great strides in just a few years. But despite how smart contemporary agents are, their ability to actually do things remains limited. Anthropic is among an emerging
[2]
Anthropic's New AI Model Takes Control of Your Computer
Anthropic says it is teaching its Claude AI model to perform general computing tasks based on prompts. In demonstration videos, the model is shown controlling the cursor of a computer to conduct research for an outing on the town, searching the web for places to visit near the user’s home and
[3]
Anthropic Wants Its AI Agent to Control Your Computer
Claude is the first major AI model to be able to take control of a computer to do useful work. It took a while for people to adjust to the idea of chatbots that seem to have minds of their own. The next leap into the unknown may involve trusting artificial intelligence to take over our computers,
[4]
Anthropic says latest AI model can control users' computers
Anthropic has enabled its artificial intelligence to control actions on a computer, including searching the internet, clicking buttons and inputting text, as companies increasingly seek to leverage the new technology to build virtual agents. The "Computer Use" feature, unveiled for developers on
[5]
Anthropic's Updated AI Models Can Control Your Computer for You
Claude AI can now take over your mouse and keyboard. Credit: Anthropic If you've always wanted to offload some of your tedious computing busywork to artificial intelligence, that future is now a little closer: The updated Claude 3.5 Sonnet AI model that Anthropic just released is capable of taking
[6]
Anthropic's latest AI model can use a computer just like you - mistakes and all
Claude 3.5 Sonnet is available as a beta for developers to try out now. It can view a screen, move a cursor, click buttons, and even input text. It's not perfect, but neither are you! Imagine an AI model that can work with a computer all on its own. Well, imagine no longer because such an AI has
[7]
Anthropic's Claude can now control computers like people do | Digital Trends
Anthropic's already impressive Claude 3.5 Sonnet gains a significant performance boost on Tuesday as the generative AI startup rolls out an enhanced and updated version of the model alongside the new, lightweight Claude 3.5 Haiku. The Sonnet update includes a public beta feature that gives the AI
[8]
Anthropic's Latest Claude Lets AI Take Control of Your Entire PC
If for some reason you wanted to hand over total control of your personal computer to an AI model, you can now do that with Anthropic. The Amazon-backed OpenAI competitor released a new version of its Claude 3.5 Sonnet model on Tuesday, which is capable of a bunch of fundamental tasks on your
[9]
Anthropic's agentic Computer Use is giving people 'superpowers'
Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More It's been only two days since Anthropic released its new Claude feature "Computer Use," but already, early adopters of varying technical abilities are finding all kinds of
[10]
Anthropic is letting Claude AI control your PC
Anthropic's latest development gives its Claude AI assistant the ability to control a PC, reportedly just like a person would. The feature, dubbed 'computer use,' entered public beta today. With computer use, Claude can be directed to execute tasks such as "looking at a screen, moving a cursor,
[11]
Anthropic Wants Claude AI to Use Computers the Way You Do
Startup Anthropic is adding a series of upgrades to its Claude AI model -- including the ability to interact with computer interfaces much like a human does. That ability, which the company calls simply "computer use," could automate complex tasks by teaching the AI the skills you use to interact
[12]
Anthropic Unleashes New Claude 3.5 Sonnet: A Model Smart Enough to Take Over Your Computer - Decrypt
Reddit users spotted it first -- Claude had suddenly gotten sharper, more capable. Now we know why: Anthropic has rolled out significant upgrades to its AI models, including an enhanced Claude 3.5 Sonnet and a much needed upgrade to its lightweight Haiku model. Eeriest update of all: These AIs can
[13]
Anthopic's latest AI update can use a computer on its own
Anthropic's latest Claude 3.5 Sonnet AI model has a new feature in public beta that can control a computer by looking at a screen, moving a cursor, clicking buttons, and typing text. The new feature, called "computer use," is available today on the API, allowing developers to direct Claude to work
[14]
Anthropic just gave Claude AI access to your computer -- here's why this is a big deal
Anthropic, the AI lab behind the popular Claude chatbot has just dropped a bombshell announcement that nobody expected. As well as a slew of new model updates, we're now about to enjoy an updated Claude 3.5 Sonnet with Computer Use. This is a new feature that builds on Artifacts, a tool that lets
[15]
Anthropic's Claude AI Can Now Control Your Computer Without Any Help
Computer use is currently in beta and available on the API to try out. Anthropic has updated its Claude 3.5 Sonnet AI model and along with that, it has brought the ability to carry out tasks on the computer for you. The new feature, called a very obvious 'computer use', is designed to mimic human
[16]
Anthropic's new Claude AI model can control your computer
Why it matters: This doesn't mean that bots have busted free of the chat box to run loose on the desktop and in the browser -- but that day looks much closer, and increasingly inevitable. State of play: Anthropic's "computer use" lets developers and advanced users tell Claude to go off and do
[17]
A new AI feature can control your computer to follow your orders
An unseen, non-human hand moving the cursor across your computer screen and typing without using the keyboard in fiction is usually a sign of malicious AI hijacking something (or a friendly ghost helping you solve mysteries like the TV show Ghost Writer). Thanks to Anthropic's new computer use
[18]
Anthropic's latest Claude model can interact with computers
For starters, it could launch a prompt injection attack on itself... The latest version of AI startup Anthropic's Claude 3.5 Sonnet model can use computers - and the developer makes it sound like that's a good thing. "Why is this new capability important?" the AI biz wonders aloud in its
[19]
The Rise of the Self-Clicking Computer
AI startup Anthropic, creator of popular chatbot Claude, announced a new feature this week called "computer use," which is a set of tools "that can manipulate a computer desktop environment." In plain English, as the name suggests, it's an AI that can use your machine for you: Over the past year,
[20]
Claude AI Gets Bored During Coding Demonstration, Starts Perusing Photos of National Parks Instead
It turns out that not even AI models are immune to a little procrastination. While its developers were trying to record a coding demonstration, the latest version of Claude 3.5 Sonnet -- Anthropic's current flagship AI -- got off track and produced some "amusing" moments, the company said in an
[21]
Anthropic's new Claude AI model can use a PC 'the way people do'
If you're worried about artificial intelligence taking your job, you might want to sit down for this one. AI startup Anthropic has demonstrated a new "Claude" model called that can look at a computer screen and operate a virtual mouse and keyboard, "the way people do," according to promotional
[22]
Anthropic releases improved Claude models that can control your computer - SiliconANGLE
Anthropic releases improved Claude models that can control your computer Leading artificial intelligence firm Anthropic PBC today introduced new Claude 3.5 Sonnet and Claude 3.5 Haiku generative AI models with significantly upgraded capabilities over their predecessors. The upgraded Sonnet
[23]
Dawn of the Agent: New Claude AI can take over your computer
Claude navigates between multiple apps and windows to get the job done The next wave of game-changing AI models will soon be upon us - "agent" style models that'll be able to take over entire ongoing tasks and jobs with full autonomy. Anthropic's newest AI model gives us a sneak peek, by taking
[24]
Anthropic Builds 'FSD' for Computers, Beats Microsoft at the Game
OpenAI's rival Anthropic, the AI safety and research company, is changing the way humans interact with computers. The company recently unveiled an upgraded Claude 3.5 Sonnet model, the new Claude 3.5 Haiku, and a public beta for an experimental feature called 'computer use.' Developers can now use
[25]
Anthropic beta lets Claude AI operate users' computer mouse, keyboard
Artificial intelligence company Anthropic announced the launch of a new version of its Claude AI model alongside a developer's beta for "computer use" on Oct. 22. The computer use beta will allow developers working with the API to enable Claude to take control of their mouse cursor, click on
[26]
Anthropic's Claude 3.5 Now Controls Your Computer Like You Do
Both Claude 3.5 Sonnet and Claude 3.5 Haiku, along with the computer use feature, are available through Anthropic's API, Amazon Bedrock, and Google Cloud's Vertex AI. Anthropic has announced the release of an upgraded Claude 3.5 Sonnet model and the new Claude 3.5 Haiku, along with a public beta
[27]
Anthropic releases AI tool that can take over your cursor
Not every artificial intelligence application sounds useful in everyday life, but Anthropic just unveiled one that could be. Anthropic announced on its website that its "Claude" large language model has gotten an intriguing new feature: computer use. Put simply, this AI can take over your mouse
[28]
Anthropic's newest AI model could control your computer
The company said the upgraded Claude model will be able to 'use computers the way people do' but warned its still experimental at this stage. OpenAI challenger Anthropic has released an upgraded version of its Claude 3.5 Sonnet model that is designed to understand and interact with any desktop
[29]
One of the best ChatGPT competitors can now control your computer screen for you
Anthropic's new "Computer Use" feature has incredible potential Whether you're fully immersed in AI tech or have only heard snippets of top conversations, you've likely heard of OpenAI's ChatGPT. Despite its widespread popularity, GPT-4o, Open AI's best model to date, is now less powerful than a
[30]
Anthropic's Claude now can use a computer
Anthropic has announced the launch of two new AI models: an upgraded Claude 3.5 Sonnet and a new Claude 3.5 Haiku. The upgraded Claude 3.5 Sonnet offers across-the-board improvements, with significant gains in coding capabilities. The new Claude 3.5 Haiku brings advanced AI features at an
[31]
Claude AI Can Now Control Your PC, Prompting Concern From Security Experts
With its latest update, the Claude AI tool from Amazon-backed Anthropic can control your computer. The idea is to have Claude "use computers the way people do," but some AI and security experts warn it could facilitate cybercrime or impact user privacy. The feature, dubbed "computer use," means
[32]
Anthropic publicly releases AI tool that can take over the user's mouse cursor
AI software company Anthropic has announced a new tool that can take control of the user's mouse cursor and perform basic tasks on their computer. Announced alongside other improvements to Anthropic's Claude and Haiku models, the tool is straightforwardly called "Computer Use." It's available
[33]
Anthropic gives its AI models limited ability to control your computer
According to a series of example videos from Anthropic posted Tuesday on X, Claude users might now ask the AI to follow the steps needed to create a personal website. In another example, a user asks Claude to help with the logistics of a trip to watch the sunrise from the Golden Gate bridge. The
[34]
Anthropic's new AI can use computers like a human, redefining automation for enterprises
Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More Anthropic, the AI research and safety company, has announced a new suite of capabilities -- including an upgraded version of its flagship AI model, Claude 3.5 Sonnet, and
[35]
Anthropic's Computer-Controlling Agents Open Door to Real World Uses, Experts Say | PYMNTS.com
Anthropic has unleashed AI agents that can surf the web and control computers, intensifying the race to commercialize AI assistants that can actually get things done. The move puts Anthropic in direct competition with tech giants Microsoft, Google, and OpenAI, who are all vying to automate routine
[36]
Anthropic's New Claude 3.5 Sonnet Can Complete Tasks on Your PCs
Anthropic also announced an upgraded Claude 3.5 Haiku model Computer Use capability is currently available via API Claude 3.5 Sonnet is said to outperform ChatGPT-4o and Gemini 1.5 Pro Anthropic introduced two new artificial intelligence (AI) models and a new AI capability on Tuesday. The biggest
[37]
How To Setup Claude Computer Use API to Control Your Computer - Beginners Guide
This week, Anthropic rolled out updates to its AI models and introduced a very interesting Computer Use API that allows AI to control your computer. Imagine a world where your computer anticipates your needs, executing tasks with just a simple prompt. It may sound like science fiction, but with the
[38]
Anthropic's new AI model can control your PC
In a pitch to investors last spring, Anthropic said it intended to build AI to power virtual assistants that could perform research, answer emails, and handle other back-office jobs on their own. The company referred to this as a "next-gen algorithm for AI self-teaching" -- one it believed that
[39]
Anthropic just dropped Claude Haiku 3.5 and gave the chatbot a huge upgrade -- here's what's new
Anthropic, a leader in the AI space, today announced a major upgrade to its Claude models with an update to its already impressive Claude 3.5 Sonnet and a brand new offering, Claude 3.5 Haiku. In addition to these upgrades, Anthropic is rolling out an exciting new feature in beta, which allows AI
[40]
Anthropic Just Released Its Most Advanced Small AI Model Yet
Anthropic's family of AI models, named Claude, come in three sizes. They are Opus (the largest but most expensive), Sonnet (which is medium in both size and cost) and Haiku (the smallest and least expensive). According to a blog post on Anthropic's website, Claude 3.5 Haiku is available for the
[41]
Anthropic's New Claude Updates and API: Transforming AI-Computer Interaction
Anthropic has unveiled two new AI models and a Computer Use API, marking a significant leap forward in technological capabilities. These developments are poised to transform how you interact with digital tools, offering substantial enhancements in both performance and efficiency. Anthropic's
[42]
Now AI Can Operate Computers Like Humans: OpenAI Rival Backed By Google Unveils Claude Upgrades Amid Fears Of Job Displacement - Alphabet (NASDAQ:GOOG), Amazon.com (NASDAQ:AMZN)
OpenAI rival Anthropic has unveiled an upgrade to its its AI model Claude 3.5 Sonnet along with introducing a new model, Claude 3.5 Haiku. The Claude 3.5 Sonnet model introduces a groundbreaking feature that allows it to interact with computers in a human-like manner. What Happened: While the
[43]
Claude 3.5 Haiku : The Future of AI Coding
Anthropic has this week updated it's Claude 3.5 Haiku AI model refining its processing powers to offer a blend of speed, accuracy, and affordability that sets a new standard in the industry. It's clear that Claude 3.5 Haiku is more than just an upgrade; With its unparalleled efficiency in handling
Share
Copy Link
Anthropic introduces a groundbreaking feature allowing its AI model, Claude, to control computers, potentially revolutionizing task automation and human-AI interaction.
Anthropic Unveils Groundbreaking AI Computer Control Feature
Anthropic, a leading AI company, has introduced a revolutionary feature that allows its AI model, Claude, to control computers directly. This development marks a significant shift from AI that merely generates text to agents capable of performing actions, potentially transforming how we interact with technology
1
.How Claude's Computer Control Works
Claude 3.5 Sonnet, the latest version of Anthropic's AI model, can now control a computer's cursor and input information via a virtual keyboard. The AI achieves this by:
- Taking screenshots of the computer screen
- Analyzing the content and layout
- Determining the distance between the cursor and desired interaction points
- Sending commands to perform actions
2
This capability allows Claude to perform a wide range of tasks, including web searches, document retrieval and modification, and interaction with various software programs
1
.Practical Applications and Demonstrations
Anthropic has showcased Claude's abilities through several demonstrations:
- Planning an outing: Claude searched the web for information, found optimal viewing spots and times, and created a calendar event
3
. - Website creation: The AI used its own interface to generate code, then utilized Visual Studio Code to build and test a simple website
3
. - Form filling: Claude accessed multiple databases and browser tabs to gather information and complete a form autonomously
5
.
Potential Impact and Future Prospects
This advancement could lead to significant changes in how we work and interact with computers:
- Automation of repetitive tasks, potentially saving hours of human labor
4
. - Enhanced productivity by allowing humans to focus on more creative and complex tasks
3
. - Development of more sophisticated AI agents capable of handling a wide range of computer-based tasks
1
.
Related Stories
Challenges and Limitations
While promising, the technology is still in its early stages and faces several challenges:
- Potential for errors and unexpected behaviors, such as getting sidetracked during tasks
2
. - Security concerns, particularly regarding access to sensitive data
1
. - Limited capabilities in certain areas, such as scrolling, dragging, and zooming
5
.
Industry Context and Competition
Anthropic's development aligns with a broader industry trend towards creating more autonomous AI agents:
- Microsoft recently announced similar capabilities for its Copilot assistant
2
. - Other companies like OpenAI and Meta are also working on agentic systems
4
.
As the technology evolves, it will be crucial to address safety concerns, build user trust, and find the right balance between AI assistance and human control in computing tasks.
References
Summarized by
Navi
Related Stories
Anthropic Unveils AI-Powered Computer Automation for Developers
23 Oct 2024•Technology
Anthropic Unveils Groundbreaking 'Computer Use' Capability in AI Models, Challenging OpenAI's Dominance
30 Oct 2024•Technology
Claude AI can now control your computer to complete tasks, but security risks remain
23 Mar 2026•Technology
Recent Highlights
1
OpenAI Launches Astra AI Model With Critical Cyber Abilities Amid Safety Debate
Technology
2
OpenAI Agents Escape Sandbox, Post 18,000 Messages on German Wiki to Share Hacking Techniques
Policy and Regulation
3
Anthropic AI Completes 10-Year Mathematical Proof Project in Just 11 Days Using Claude
Technology
Recent Highlights
Today's Top Stories
Don’t drown in AI news. We cut through the noise - filtering, ranking and summarizing the most important AI news, breakthroughs and research daily. Follow topics that matter to you and stay ahead.
