macOS, Windows, Linux에서 accessibility tree를 읽고 백그라운드 입력을 수행하여 AI agent가 데스크톱을 제어할 수 있게 합니다.
다른 이름 munimtechnologies/computer-use, computer-use, munim-computer-use
- 스타
- 38
- Tools
- 2
- 다운로드, 30일
- —
- 최신 버전
- 0.1.0
- 마지막 커밋
- 2026년 11월 8일
- 라이선스
- Apache-2.0
Computer Use MCP란?
Computer Use은(는) MCP server입니다. macOS, Windows, Linux에서 accessibility tree를 읽고 백그라운드 입력을 수행하여 AI agent가 데스크톱을 제어할 수 있게 합니다. 2개 도구를 제공합니다. 예: wait_timeout_ms, readiness.
프로젝트 README에서 생성된 요약
Computer Use MCP server 정보
개발자는 이 MCP server를 사용하여 AI agent에게 데스크톱 환경에 대한 직접적인 제어 권한을 부여할 수 있습니다. 이 서버는 코딩 agent가 macOS, Windows, Linux 시스템을 사람처럼 상호작용할 수 있게 하는 computer-use agent 백엔드로 작동합니다. accessibility tree를 읽어 특정 element ID를 식별함으로써, 모든 상호작용에 vision model이 필요하지 않아도 agent가 클릭과 타이핑을 할 수 있도록 지원합니다.
가장 큰 특징은 백그라운드 입력을 수행할 수 있다는 점입니다. 즉, agent가 백그라운드에서 작동하므로 사용자는 물리적인 마우스와 키보드를 자신의 용도로 계속 사용할 수 있습니다. 이 서버는 Claude Code, Codex, Cursor, MT Code를 포함한 다양한 MCP client와 함께 작동합니다. 설정 방법은 플랫폼별 binary를 다운로드한 후 CLI 또는 설정 파일을 통해 선택한 agent에 등록하는 방식입니다. 앱 상태 확인, element ID를 통한 동작 수행, 스크린샷을 통한 동작 검증 도구를 제공합니다.
활용 사례
- 1애플리케이션 간 워크플로우 자동화AI agent가 웹 브라우저를 열어 특정 정보를 찾은 다음, 해당 데이터를 로컬 메모 앱으로 옮길 수 있습니다.
- 2백그라운드 데스크톱 작업 수행사용자가 마우스와 키보드로 다른 작업을 하는 동안 agent가 컴퓨터에서 작업을 수행하도록 할 수 있습니다.
- 3element ID를 통한 정밀한 UI 상호작용픽셀 좌표를 추측하는 대신, accessibility 데이터를 사용하여 특정 버튼 및 컨트롤과 상호작용할 수 있습니다.
프로젝트의 README를 바탕으로 작성되었습니다. 모든 활용 사례는 해당 내용의 인용문과 대조하여 확인합니다.
Computer Use MCP 설치 방법
형식 확인: 2026년 11월 10일Cursor에 추가Goose에 추가Claude Code에 Computer Use MCP 설치
$ claude mcp add computer-use -- npx -y munim-computer-useCursor에 Computer Use MCP 설치
~/.cursor/mcp.json
{
"mcpServers": {
"computer-use": {
"command": "npx",
"args": [
"-y",
"munim-computer-use"
]
}
}
}VS Code에 Computer Use MCP 설치
.vscode/mcp.json
{
"servers": {
"computer-use": {
"type": "stdio",
"command": "npx",
"args": [
"-y",
"munim-computer-use"
]
}
}
}VS Code CLI에 Computer Use MCP 설치
$ code --add-mcp '{"name":"computer-use","type":"stdio","command":"npx","args":["-y","munim-computer-use"]}'Claude Desktop에 Computer Use MCP 설치
claude_desktop_config.json
{
"mcpServers": {
"computer-use": {
"command": "npx",
"args": [
"-y",
"munim-computer-use"
]
}
}
}Codex에 Computer Use MCP 설치
$ codex mcp add computer-use -- npx -y munim-computer-useCodex config.toml에 Computer Use MCP 설치
~/.codex/config.toml
[mcp_servers.computer-use] command = "npx" args = ["-y", "munim-computer-use"]
Gemini CLI에 Computer Use MCP 설치
$ gemini mcp add -s user computer-use npx -- -y munim-computer-useGemini settings.json에 Computer Use MCP 설치
~/.gemini/settings.json
{
"mcpServers": {
"computer-use": {
"command": "npx",
"args": [
"-y",
"munim-computer-use"
]
}
}
}Computer Use MCP 도구 2
README에서 감지됨wait_timeout_msreadiness
| wait_timeout_ms | — | |
| readiness | — |
구성
COMPUTER_USE_AGENT_CURSORSet to 0 to disable the agent pointer overlay
COMPUTER_USE_BROWSERSet to 0 to hide the browser_* tools
| 이름 | 설명 | 유형 |
|---|---|---|
| COMPUTER_USE_AGENT_CURSOR | Set to 0 to disable the agent pointer overlay | |
| COMPUTER_USE_BROWSER | Set to 0 to hide the browser_* tools |
자동 검사
2026년 11월 12일에 실행됨전체 보고서 →자동 검사를 통과했습니다. 이는 보안 감사가 아닙니다. 코드를 직접 읽고 서버에 필요한 최소한의 권한만 부여하십시오. 검사 방식
- 소스 저장소 연결 및 접근 가능통과
- 오픈 소스 라이선스 (OSI)통과
- 최근 1년 내 커밋 또는 릴리스통과
- 패키지 이름이 인기 패키지와 유사하지 않음통과
- 원격 엔드포인트가 HTTPS 사용검사되지 않음
- 파괴적인 도구에 라벨 표시됨통과
- 모델에 대한 숨겨진 지침 없음통과
- 패키지 및 해당 종속성에 중요한 보안 권고 없음통과
README
GitHub에서 보기Introduction
Computer Use is an open-source MCP server — a computer-use agent (CUA) backend — that lets any coding agent use your computer the way a person does. It reads the screen through accessibility trees, clicks and types in the background so your mouse stays yours, shows an agent pointer where it is working, zooms in on small text, and drives tabs in your signed-in Chrome — on macOS, Windows and Linux.
Works with Claude Code, Codex, Cursor and MT Code, or any other MCP client, with any model — no vision model is required for interaction.
Built by Munim Technologies as the Computer Use engine of MT Code, and published here on its own.
Table of contents
- Quick start
- Capability matrix
- Benchmarks
- Why it works well
- Works alongside you
- Apps and sites the agent may use
- Tools
- Repository layout
- Environment flags
- Embedding in an app
- Prompting your agent
- Contributing
- Credits and license
Quick start
- Download the latest binary for your platform from Releases (
munim-computer-use-macos-universal.zip,munim-computer-use-windows-x64.zip) or build from source. - Put it somewhere on your
PATH(/usr/local/bin/munim-computer-use, or%LOCALAPPDATA%\Programs\munim-computer-use\munim-computer-use.exe). - macOS only: run
munim-computer-use request-permissionsonce to be prompted for Accessibility and Screen Recording. - Register it with your agent:
# Claude Code — fastest: the npm launcher fetches the signed binary on first run.
# Add `--scope user` to register it for every project instead of just this one.
claude mcp add munim-computer-use -- npx -y munim-computer-use
# or point at a downloaded binary
claude mcp add munim-computer-use -- /usr/local/bin/munim-computer-use
# Codex — writes the entry below into ~/.codex/config.toml for you (needs a Codex CLI
# with `codex mcp`; check with `codex mcp --help`)
codex mcp add munim-computer-use -- npx -y munim-computer-use
# Codex — ~/.codex/config.toml, if you would rather edit it yourself
[mcp_servers.munim-computer-use]
command = "npx"
args = ["-y", "munim-computer-use"]
# Cursor — no MCP subcommand in its CLI, so write the config. ~/.cursor/mcp.json applies
# to every project; .cursor/mcp.json in a repo applies to that one.
mkdir -p ~/.cursor && [ -s ~/.cursor/mcp.json ] || echo '{}' > ~/.cursor/mcp.json
jq '.mcpServers["munim-computer-use"] = {"command":"npx","args":["-y","munim-computer-use"]}' \
~/.cursor/mcp.json > ~/.cursor/mcp.json.tmp && mv ~/.cursor/mcp.json.tmp ~/.cursor/mcp.json
// Cursor — the entry that produces, in .cursor/mcp.json
{ "mcpServers": { "munim-computer-use": { "command": "npx", "args": ["-y", "munim-computer-use"] } } }
Then ask: "Open Safari, find the cheapest flight to Denver on Tuesday and put it in a note." The agent reads the UI with get_app_state, acts by element id, and verifies with screenshot.
Capability matrix
Munim Computer Use is the highlighted first column; the others are the computer-use servers people reach for. each cell comes from that project's own README or docs in September and October 2026 (sources under Credits and license). ✅ present · ❌ absent or not documented · ⚠️ partial.
| Capability | Munim Computer Use | Cua Driver | Codex Computer Use | OpenAI Agents API | Anthropic reference demo | Windows-MCP | MacOS-MCP | open-computer-use | computer-use-mcp (zavora) | Notes |
|---|---|---|---|---|---|---|---|---|---|---|
| macOS | ✅ | ✅ | ✅ | n/a | ❌ | ❌ | ✅ | ✅ | ✅ | The Anthropic demo drives a Linux desktop inside Docker, not your machine. The OpenAI Agents API (September 2026) runs a browser OpenAI hosts, so it never drives your machine either. |
| Windows | ✅ | ✅ | ✅ | n/a | ❌ | ✅ | ❌ | ✅ | ✅ | Windows-MCP is Windows only; MacOS-MCP is macOS only. |
| Linux | ✅ | ✅ | ❌ | n/a | ✅ (sandbox) | ❌ | ❌ | ✅ | ✅ | Munim Computer Use uses AT-SPI + X11; native Wayland apps get element actions but not coordinate clicks. |
| Accessibility tree with element ids | ✅ | ✅ | ⚠️ | ❌ | ❌ | ✅ | ✅ | ✅ | ✅ | Codex reads the accessibility tree first on macOS and works from screenshots on Windows; the Agents API and the Anthropic demo are screenshot-driven. Ids let the agent press the button instead of a pixel. |
| Background input (your mouse never moves) | ✅ | ✅ | ⚠️ | n/a | n/a | ❌ | ❌ | ❌ | ❌ | Munim Computer Use addresses events to the target window: always on macOS (SkyLight and per-process events), for UI Automation patterns and classic Win32 controls on Windows; other Windows UI and all Linux pointer input (XTEST) still move the real pointer. Codex works in the background on macOS with cursors of its own, and takes over the pointer on Windows. Cua Driver delivers in the background by default and falls back to the foreground when that does not land. The other servers in this table drive the real cursor. |
| Agent pointer overlay | ✅ | ✅ | ✅ | ❌ | ❌ | ⚠️ | ❌ | ❌ | ❌ | Windows-MCP flashes a border around captures; Codex and Cua Driver draw their own cursor on your screen. |
| Zoom into a region at full resolution | ✅ | ✅ | ❌ | ❌ | ✅ | ❌ | ❌ | ❌ | ❌ | Anthropic's toolset has zoom; here it is a tool on every platform. |
| Screenshots carry screen-coordinate mapping | ✅ | ⚠️ | n/a | n/a | n/a | ❌ | ❌ | ❌ | ❌ | Origin and pixels-per-point in every capture, so clicks from Retina or downscaled images land. |
| Hover, wait, label query | ✅ | ⚠️ | ⚠️ | ❌ | ⚠️ | ✅ | ⚠️ | ❌ | ⚠️ | Windows-MCP has Wait/WaitFor; MacOS-MCP has Wait; Anthropic has wait/mouse_move. |
| Your signed-in Chrome, own tab group or yours | ✅ | ⚠️ | ⚠️ | ❌ | ❌ | ⚠️ | ❌ | ❌ | ❌ | Codex uses its in-app browser; Cua Driver attaches to a browser over CDP; Windows-MCP reads the DOM of open browsers. Munim Computer Use opens its own labelled tab group in your real Chrome, and can also take over a tab you already have open when you ask it to. |
| Act and observe in one call | ✅ | ✅ | n/a | n/a | ✅ | ❌ | ❌ | ❌ | ❌ | return_state on any action appends the fresh accessibility tree or page snapshot, so one call acts and checks. Cua Driver's run_steps runs several actions and reports what changed. The Anthropic demo returns a screenshot after each action; Codex and the Agents API run the loop themselves. |
| Several actions in one call | ✅ | ✅ | n/a | n/a | ❌ | ⚠️ | ❌ | ❌ | ✅ | Cua Driver and computer-use-mcp (zavora) run a list of steps in one call with run_steps; Windows-MCP's MultiSelect and MultiEdit act on several elements at once. Munim Computer Use's run_steps does the same, checks the whole list before running any of it, and stops at the first failure. |
| Read a page's text in a signed-in tab | ✅ | ⚠️ | ❌ | ❌ | ❌ | ⚠️ | ❌ | ❌ | ❌ | browser_read returns the page as text with headings, in chunks, with a query filter, from a background tab. Windows-MCP scrapes pages. |
| Sign-in without the model seeing the password | ✅ | ❌ | ❌ | ✅ | ❌ | ❌ | ❌ | ❌ | ❌ | browser_request_credentials opens a Chrome window naming the site's real origin; what the user types goes into the page and never into the conversation. The Agents API hands sign-in to the developer's app the same way. Desktop password fields refuse typing by default. |
| Per-app and per-site allow / ask / block rules | ✅ | ❌ | ⚠️ | ⚠️ | ❌ | ❌ | ❌ | ❌ | ❌ | A policy file the user controls; ask shows an approval prompt once per task. Codex asks before each new app and keeps an "Always allow" list; the Agents API asks the developer's app before each new website. |
| Works with any MCP client | ✅ | ✅ | ❌ | ❌ | ❌ | ✅ | ✅ | ✅ | ✅ | Codex Computer Use is Codex only; the Anthropic demo is Claude only. |
| Identical tool surface on every platform | ✅ | ⚠️ | n/a | n/a | n/a | n/a | n/a | ⚠️ | ✅ | 38 tools with byte-identical schemas across the Swift and Rust servers. Cua Driver keeps shared parameters in step with a CI check, with a few tools on one platform only. |
| Prebuilt signed binaries + npm launcher | ✅ | ✅ (script) | ✅ | n/a | ❌ | ❌ | ❌ | ✅ (npm) | ✅ (npm) | macOS universal (Developer ID signed) and Windows x64 on Releases. |
| Open source | ✅ Apache-2.0 | ✅ MIT | ❌ | ❌ | ✅ | ✅ MIT | ✅ MIT | ✅ MIT | ✅ MIT |
Also looked at: mediar-ai/mcp-server-macos-use (macOS, accessibility, real input), deploymenttheory/windows-mcp-server (Windows, UIA Invoke patterns, WaitFor), nuphus-mcp (OCR + bring-your-own vision model, CDP Chrome), computer-control-mcp (PyAutoGUI + OCR), and microsoft/playwright-mcp (browser only). Corrections welcome — open an issue with a link.
The chart counts the table above (n/a cells are left out), so
Computer Use MCP 질문
Computer Use MCP를 Claude Code에 추가하려면 어떻게 하나요?
터미널에서 claude mcp add computer-use -- npx -y munim-computer-use를 실행합니다. 모든 프로젝트에서 사용할 수 있게 하려면 --scope user를 추가합니다.
Computer Use MCP를 Cursor에 추가하려면 어떻게 하나요?
~/.cursor/mcp.json를 열고 mcpServers 아래에 서버를 추가합니다. 위 설치 섹션에 표시된 Cursor 구성을 사용합니다.
Computer Use MCP는 어떤 도구를 제공하나요?
2개 도구를 제공합니다. 예: wait_timeout_ms, readiness.
agent가 작동하는 동안 마우스가 움직이나요?
아니요, 백그라운드 입력을 수행하므로 마우스는 계속 사용자가 제어할 수 있습니다.
macOS에서 권한은 어떻게 부여하나요?
'munim-computer-use request-permissions' 명령어를 실행하여 Accessibility 및 Screen Recording 권한을 요청해야 합니다.