tauri-plugin-mcp-gui 0.1.0

A Tauri plugin that enables AI agents to interact with desktop GUIs through screenshots, DOM access, and input simulation utilizing MCP
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79

# Tauri Plugin: Model Context Protocol (MCP)

A Tauri plugin and MCP server that enables AI agents (Claude Code, Cursor, etc.) to interact with and debug Tauri desktop applications through standardized interfaces.

**Author:** Jarad DeLorenzo ([@delorenj](https://github.com/delorenj))
**Repository:** https://github.com/delorenj/tauri-plugin-mcp
**Homepage:** https://delorenj.github.io

### Features

The Tauri MCP Plugin provides a comprehensive set of tools that allow AI models and external applications to interact with Tauri applications:

#### Window Interaction
- **Take Screenshot**: Capture images of any Tauri window with configurable quality and size
- **Window Management**: Control window position, size, focus, minimize/maximize state
- **DOM Access**: Retrieve the HTML DOM content from webviews windows

#### User Input Simulation
- **Mouse Movement**: Simulate mouse clicks, movements, and scrolling
- **Text Input**: Programmatically input text into focused elements
- **Execute JavaScript**: Run arbitrary JavaScript code in the application context

#### Data & Storage
- **Local Storage Management**: Get, set, remove, and clear localStorage entries
- **Ping**: Simple connectivity testing to verify the plugin is responsive

## Quick Start

### Building the Plugin

```bash
bun install
bun run build && bun run build-plugin
```

### MCP Server Setup

```bash
cd mcp-server-ts
bun install
bun run build
```

### Basic Configuration

Add to your Claude Code or Cursor MCP settings:

```json
{
  "mcpServers": {
    "tauri-mcp": {
      "command": "node",
      "args": ["/path/to/tauri-plugin-mcp/mcp-server-ts/build/index.js"]
    }
  }
}
```

## Documentation

- **[Setup Guide](./docs/SETUP.md)** - Detailed integration instructions
- **[MCP Server](./docs/MCP_SERVER.md)** - Available tools and configuration
- **[Troubleshooting](./docs/TROUBLESHOOTING.md)** - Common issues and solutions

## Architecture

The plugin uses a multi-layer communication stack:

```
AI Agent (Claude Code/Cursor)
         ↓ (MCP Protocol)
    MCP Server (Node.js)
         ↓ (IPC/TCP Socket)
   Socket Server (Rust)
         ↓ (Tauri APIs)
   Tauri Application
```

Supports both IPC (Unix sockets/named pipes) and TCP connections for maximum flexibility.