Claude can now control your computer

Moritz | AI Builder · Intermediate ·🧠 Large Language Models ·3mo ago

Key Takeaways

Claude AI controls computer with voice commands, navigating tools end-to-end, using features like computer use and typing messages in applications like Telegram.

Full Transcript

Claude can now control your entire computer. Check this out. Go to settings, general, and then turn on computer use. Now, in Cowork, I can just say something like, "Use computer use and open up Telegram, then look for Ari, and type this is Claude through computer use typing the message." Okay, we'll hit that off. Okay, you have to approve that you can use Telegram for the session. Now, you can see the red beaming light around the desktop, which means that it's controlling my desktop right now. Now, it just found Ari here, clicked on it. Now, it's asking, "I'm about to type this is Claude." Let's say, "Yes." And there we go, it typed, "This is Claude." And now, it's being extra safe. Yes, send it. Okay. And it was sent. So, this is pretty crazy. Any task that you would normally do on your desktop can now basically be passed onto Claude. And this is especially useful if you don't have access to your desktop and you want to control it through your phone. So, you can just use dispatch and send that message to Claude Cowork running on your desktop and it can go do things for you on your computer. Comment computer and I'll send you a quick setup guide.

Original Description

Claude can now control your computer. It can click, type, and navigate tools end to end. This is what real AI agents look like.
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Claude AI can control your computer with voice commands, allowing you to automate tasks and interact with applications like Telegram. This feature enables remote control of your desktop and can be especially useful when you don't have physical access to your computer.

Key Takeaways
  1. Go to settings and turn on computer use
  2. Use voice commands to control Claude AI
  3. Open applications like Telegram and perform tasks
  4. Approve actions and send messages
  5. Use dispatch to send messages to Claude Cowork on your desktop
💡 Claude AI's ability to control your computer with voice commands enables a new level of automation and remote interaction, making it possible to perform tasks on your desktop without physical access.

Related Reads

📰
A Silent Crash in Megatron-LM’s Gradient Clipping (and a Reviewer Who Made My Fix Better)
Learn how a reliability bug in Megatron-LM's gradient clipping was fixed and why the simplest solution isn't always the first one you write
Medium · Machine Learning
📰
Had issue with Token usage limits, so converting my text prompts to image
Convert text prompts to images to bypass token usage limits with near-perfect accuracy using optical compression
Reddit r/webdev
📰
Part 3: The Ablation — When Fairness and Language Model Quality Conflict
Learn how bias-aware IPW loss affects fairness and language model quality in real-world scenarios, and understand the trade-offs between these two goals
Medium · Data Science
📰
Nemotron Labs: How Open Models Give Enterprises and Nations AI They Can Trust, Control and Customize
Learn how open models can give enterprises and nations AI they can trust, control, and customize to improve workflows and exceed accuracy standards
NVIDIA AI Blog
Up next
5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems
Dave Ebbelaar (LLM Eng)
Watch →