# OpenEye MCP server

> Enables AI agents to verify AR/XR procedural steps by processing visual scene descriptions and managing structured session memory.

- Repository: https://github.com/dumbspacecookie/openeye
- Page: https://hostedmcp.org/servers/dumbspacecookie/openeye
- Transport: stdio
- Stars: 2
- License: MIT
- Latest version: 0.1.1

## Install

### Claude Code

```sh
claude mcp add --env 'ANTHROPIC_API_KEY=<YOUR_ANTHROPIC_API_KEY>' --env 'OPENEYE_CONTEXT_API_KEY=<YOUR_OPENEYE_CONTEXT_API_KEY>' openeye -- npx -y @dumbspacecookie/openeye
```

### Cursor (`~/.cursor/mcp.json`)

```json
{
  "mcpServers": {
    "openeye": {
      "command": "npx",
      "args": [
        "-y",
        "@dumbspacecookie/openeye"
      ],
      "env": {
        "ANTHROPIC_API_KEY": "<YOUR_ANTHROPIC_API_KEY>",
        "OPENEYE_CONTEXT_API_KEY": "<YOUR_OPENEYE_CONTEXT_API_KEY>"
      }
    }
  }
}
```

### VS Code (`.vscode/mcp.json`)

```json
{
  "servers": {
    "openeye": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "@dumbspacecookie/openeye"
      ],
      "env": {
        "ANTHROPIC_API_KEY": "<YOUR_ANTHROPIC_API_KEY>",
        "OPENEYE_CONTEXT_API_KEY": "<YOUR_OPENEYE_CONTEXT_API_KEY>"
      }
    }
  }
}
```

### VS Code CLI

```sh
code --add-mcp '{"name":"openeye","type":"stdio","command":"npx","args":["-y","@dumbspacecookie/openeye"],"env":{"ANTHROPIC_API_KEY":"<YOUR_ANTHROPIC_API_KEY>","OPENEYE_CONTEXT_API_KEY":"<YOUR_OPENEYE_CONTEXT_API_KEY>"}}'
```

### Claude Desktop (`claude_desktop_config.json`)

```json
{
  "mcpServers": {
    "openeye": {
      "command": "npx",
      "args": [
        "-y",
        "@dumbspacecookie/openeye"
      ],
      "env": {
        "ANTHROPIC_API_KEY": "<YOUR_ANTHROPIC_API_KEY>",
        "OPENEYE_CONTEXT_API_KEY": "<YOUR_OPENEYE_CONTEXT_API_KEY>"
      }
    }
  }
}
```

### Codex

```sh
codex mcp add openeye --env 'ANTHROPIC_API_KEY=<YOUR_ANTHROPIC_API_KEY>' --env 'OPENEYE_CONTEXT_API_KEY=<YOUR_OPENEYE_CONTEXT_API_KEY>' -- npx -y @dumbspacecookie/openeye
```

### Codex config.toml (`~/.codex/config.toml`)

```toml
[mcp_servers.openeye]
command = "npx"
args = ["-y", "@dumbspacecookie/openeye"]

[mcp_servers.openeye.env]
ANTHROPIC_API_KEY = "<YOUR_ANTHROPIC_API_KEY>"
OPENEYE_CONTEXT_API_KEY = "<YOUR_OPENEYE_CONTEXT_API_KEY>"
```

### Gemini CLI

```sh
gemini mcp add -s user -e 'ANTHROPIC_API_KEY=<YOUR_ANTHROPIC_API_KEY>' -e 'OPENEYE_CONTEXT_API_KEY=<YOUR_OPENEYE_CONTEXT_API_KEY>' openeye npx -- -y @dumbspacecookie/openeye
```

### Gemini settings.json (`~/.gemini/settings.json`)

```json
{
  "mcpServers": {
    "openeye": {
      "command": "npx",
      "args": [
        "-y",
        "@dumbspacecookie/openeye"
      ],
      "env": {
        "ANTHROPIC_API_KEY": "<YOUR_ANTHROPIC_API_KEY>",
        "OPENEYE_CONTEXT_API_KEY": "<YOUR_OPENEYE_CONTEXT_API_KEY>"
      }
    }
  }
}
```

## Environment variables

| Name | Required | Secret | Description |
|---|---|---|---|
| `ANTHROPIC_API_KEY` | yes | yes | Anthropic API key for the agent. Required because the default OpenEye agent uses Claude. Swap providers via src/models.ts if you want OPENAI/GROQ/GEMINI/etc. |
| `OPENEYE_CONTEXT_API_KEY` | no | yes | Context API key. Only needed if OPENEYE_CONTEXT_OPTIN is true. |
| `OPENEYE_CONTEXT_OPTIN` | no | no | Set true to opt in to sharing trajectory data with Context's training pipeline. Default off. Loud opt-in by design — read docs/context-data.md before flipping. |

## FAQ

### Does OpenEye provide its own vision model?

No, you must bring your own vision model such as Claude vision, GPT-4o, Gemini, or a local Ollama model.

### What kind of training data can OpenEye export?

It can export ShareGPT JSONL trajectories and DPO preference pairs, which are compatible with trainers like TRL, LLaMA-Factory, or Axolotl.

### Is the data sent to the cloud by default?

No, opt-in cloud sync is off by default and configurable per data type.
