AI Board

AI BOARD

AI Board

AI tools, policy moves, and public decisions are tracked in plain language.

All posts AI Briefs Tools Policy Education Industry

Complete Guide to Claude Computer Use: AI Operates My MacBook for Me

Author
김 경진
Date
2026-03-25 08:29
Views
19

Complete Guide to Claude Computer Use

AI operates my MacBook for me, from setup to real use, one step at a time


1. What Is Claude Computer Use?

This is a feature Anthropic released on March 24, 2026. Claude directly sees your Mac screen, moves the mouse, types on the keyboard, and operates apps. It is not limited to searching in a browser. It can access every app installed on your computer, including Discord, KakaoTalk, Xcode, and the iOS Simulator.

This is how it works. Claude takes a screenshot of the screen, analyzes the image, and calculates the exact XY coordinates of a button. It moves the mouse to those coordinates, clicks, and enters text. AI reproduces the same process a person uses when looking at the screen and moving the mouse by hand.

When Claude performs a task, it follows priorities. If there is already a connected app such as Slack or Google Calendar, it uses that connector first. If an app has no connector, it switches to Computer Use and controls the screen directly.


2. Check the Requirements

There are people who can use it right now and people who still need to wait. Check the conditions below one by one.



Operating system : Only macOS is supported. Windows and Linux cannot use it yet. Anthropic has announced plans to support Windows, but no specific schedule has been disclosed.

Subscription planPro ($20/month) or Max ($100 to $200/month) individual plan is required. It cannot be used on the Free, Team, or Enterprise plans.

Where to use it : It works in the Claude Desktop app's Cowork tab or Code tab. It cannot be used in regular chat in the web browser (claude.ai).



3. Installation: Download the Claude Desktop App

Even if the Claude Desktop app is already installed, you must update to the latest version to use this feature. If you are installing it for the first time, follow the steps below.

Step 1. In your web browser, go to claude.com/download.

Step 2. Click the download button for macOS. A unified build for Intel and Apple Silicon (M series) is provided.

Step 3. Open the downloaded .dmg file and drag the Claude app icon into the Applications folder.

Step 4. Launch Claude from the Applications folder and log in with your Anthropic account.


If you already have it installed, click Claude menu -> "Check for Updates..." in the top menu bar to update to the latest version. If the Computer Use option still does not appear after the update, delete and reinstall the app, then try logging out and back in.

4. Activation: Turn On Computer Use (Core Setting)

It does not work just because you installed the app. Computer Use is off by default, and you must turn it on yourself. You also need to grant macOS system permissions.

Step 1. Open the Claude Desktop app.

Step 2. Click the Settings icon (gear shape) at the bottom left.

Step 3. In the settings window, click "Desktop app" under "General".

Step 4. Find the newly added "Computers" item. Turn the toggle switch on.

Step 5. Two macOS permissions appear right below. You must allow both.



① Accessibility : Allows Claude to click the mouse, type on the keyboard, and scroll.

② Screen Recording : Allows Claude to see what is displayed on the screen.



Press the button next to each permission, and you will move to Mac System Settings. In System Settings -> Privacy & Security -> the relevant item, add and enable the Claude app. Once both permissions are granted, the settings screen will show "Granted."


5. Running It: Give Commands from the Cowork or Code Tab

Once setup is done, it is time to try it. At the top of the Claude Desktop app, there are three tabs: Chat, Cowork, Code. Computer Use works in the Cowork and Code tabs.

Step 1. Cowork Click the tab. (If you are a developer, choose the Code tab.)

Step 2. Enter the task you want in natural language in the chat window.

Step 3. Before Claude accesses the app, an "Allow" button appears. Press it, and the task begins.

If the notification "Claude is using your computer" appears at the top of the screen, it means Claude is looking at the screen and controlling the mouse and keyboard. It is best not to touch the mouse during this time, because Claude's coordinate calculation can be thrown off.


6. Practical Examples: What You Can Ask It to Do

Let's look at what Computer Use can do through actual demo examples.



Example ① Move to a Discord server

Command: "Open Discord and move to the General channel of the ○○ server."
Result: Claude opened Discord, found the relevant server in the server list, clicked it, and moved automatically to the General channel. The user did not touch the mouse or keyboard at all.




Example ② Send a KakaoTalk message

Command: "In KakaoTalk, send the message 'Hello' to the 'vibe coding' chat room."
Result: Claude opened KakaoTalk, found the chat room in the search box, opened the room with a double-click, entered the message, and sent it.




Example ③ Click a button in the iOS Simulator

Command: "In the iOS Simulator, press the plus button and raise the number to 15."
Result: Claude identified the coordinates of the plus button from a screenshot, calculated that 7 clicks were needed because the current number was 8, then clicked automatically 7 times and reached 15.




Example ④ Remote command from a phone (Dispatch)

Command (sent from iPhone): "Press the plus button 15 times in the iOS Simulator and make it 30."
Result: When you send a command from the Claude app on iPhone through Dispatch, Claude performs the task on the Mac at home. In effect, you are remotely controlling the desktop from your phone.



7. Dispatch: Remotely Control Your Mac from Your Phone

Dispatch was released separately from Computer Use, but combining the two enables true remote work. If you give an instruction from the Claude app on iPhone or Android, Claude directly operates the screen on the Mac.

Step 1. Install the Claude app on iPhone or Android. (App Store or Google Play)

Step 2. Claude Desktop on the Mac must be running.

Step 3. Give the task from your phone through Dispatch.

Step 4. On the Mac side, "Allow Once" permission approval is required. This cannot currently be handled remotely, so you need to allow it once in the first session.


To keep the Mac from sleeping while you are out, use macOS System Settings -> Displays -> "Prevent Sleep," or use the caffeinate command in the terminal. Dispatch works only while the Mac is awake.

8. Limits and Precautions to Know

macOS only : Windows and Linux are currently unsupported. Anthropic has previewed Windows support, but the timing is unknown.

Research preview stage : This is not a finished feature yet. Bugs may occur, and if a window covers the screen, Claude may fail to recognize what is underneath.

Limits when controlling browsers : To operate a browser with Computer Use, the Claude Chrome extension (Claude in Chrome) must be installed. This is for security reasons.

Permission requests : Each time Claude accesses a new app, it asks the user whether to allow it. This is safe, but it is inconvenient because you must press the allow button manually each time.

Be careful with sensitive information : Claude takes screenshots and reads screen contents. Avoid using it while sensitive information is visible, such as financial apps, medical information, or legal documents. Investment platforms and cryptocurrency apps are blocked by default.

Looping behavior : Sometimes it cannot find the target app or button and repeats the same action. In that case, stop it, check whether anything is blocking the screen, and try again.


9. Computer Use vs OpenClaw

There is an open-source AI agent called OpenClaw that drew attention in early 2026 after passing 68,000 GitHub stars. It connects with messenger apps such as WhatsApp and Telegram and handles everything from file management to browser automation. The industry paid close attention when OpenAI acquired the project.

Claude Computer Use is Anthropic's answer to this trend. OpenClaw supports macOS, Windows, and Linux and has broad plugin-based extensibility, but setup is complex and users must manage security themselves. Claude Computer Use is limited to macOS, but because it is built into the app, setup is much easier, and its permission-first approach for each app makes security more systematic.


10. Full Setup Summary: 5-Step Checklist


☐ Step 1 : Install the latest version of Claude Desktop from claude.com/download

☐ Step 2 : Confirm subscription to Pro ($20/month) or Max ($100 to $200/month)

☐ Step 3 : Settings -> Desktop app -> General -> Computers toggle ON

☐ Step 4 : Grant two macOS permissions: Accessibility + Screen Recording

☐ Step 5 : Give a natural-language command in the Cowork or Code tab -> click Allow -> confirm it works



The era when AI replaces human hands and eyes has begun. It is still a research preview, so it is not perfect, but the direction is clear. AI agents are coming out beyond the screen and directly entering our work environment. Claude Computer Use is the first step, and many automation workflows will appear around this feature.



KIMKJ.COM

#KimKyungJin #AttorneyKimKyungJin #KimKyungJinAI #ArtificialIntelligence #AI #AIExpert #AILaw #AIPolicy #AIRegulation #AIEthics #GenerativeAI #ChatGPT #Claude #GPT #LLM #DigitalTransformation #SmartCity #AutonomousDriving #DataRegulation #GDPR #PrivacyProtection #AIGovernance #KimKyungJinFormerAssemblyman #LegalExpert #TechPolicy #AIEducation #AIAdministrativeRevolution #AIHegemonyWar #kimkj #kimkjcom


Scroll to Top
kimkj.com Home