# XuLan ScreenPilot MCP server

> Converts Windows screens into structured, numbered element tables that allow AI agents to interact with UI components via IDs instead of coordinates.

- Repository: https://github.com/dahuam/screenpilot
- Page: https://hostedmcp.org/servers/dahuam/screenpilot
- Transport: —
- Stars: 0
- License: Apache-2.0
- Latest version: 1.0.0

## FAQ

### Does this require a GPU or cloud API?

No, it runs purely on the local CPU with no cloud models, no GPU, and no API key required.

### How does the agent interact with the screen?

The agent scans the screen to create a numbered element table and then drives the screen using element IDs for actions like clicking and typing.

### What engines are used to identify screen elements?

It uses a fusion of three engines: Windows UIA for native apps, RapidOCR for games and custom UIs, and OpenCV for visual icon detection.

### Is it safe to use on sensitive windows?

Yes, it features a privacy-first mode that recognizes sensitive windows like Notepad or login dialogs and prevents them from being written into the persistent element book.
