muthr 0.1.13

A zero-trust orchestrator that automates secure inference and isolated execution of local AI agents.
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48

# muthr

[![License: MIT](https://img.shields.io/badge/License-MIT-blue.svg)](https://opensource.org/licenses/MIT)
[![Crates.io Version](https://img.shields.io/crates/v/muthr?color=orange&cacheSeconds=3600)](https://crates.io/crates/muthr)
[![GitHub Release](https://img.shields.io/github/v/release/tappunk/muthr?color=blue)](https://github.com/tappunk/muthr/releases)

**muthr** is a zero-trust orchestrator that automates **llama.cpp** and **Lima** to safely run local AI agents. Running coding agents on your machine exposes your system to unpredictable tool calls. muthr prevents this by managing the lifecycle of both tools: it controls inference via a host-based llama-server and spawns isolated Lima VMs for agent execution. Agents get full read-write access to your project workspace, but zero access to the host OS or SSH keys.

## Usage

```bash
muthr serve              # Start llama-server as a background daemon
muthr serve --foreground # Run in foreground
muthr status             # Check engine status and active profile
muthr stop               # Stop the engine

muthr up    # Provision a Debian 13 VM for the current project
muthr ls    # List all active sandboxes
muthr down  # Stop the current sandbox

muthr services start     # Launch MCP services VM
muthr services status
muthr services stop
```

## Architecture

1. `llama-server` on macOS, accelerated via Metal
2. `limactl` VMs provisioned per-project
3. [OpenCode](https://opencode.ai) inside guest VMs, connecting over `host.lima.internal`

## Prerequisites

macOS (Apple Silicon, ≥48GB RAM for 35B models), [Lima](https://github.com/lima-vm/lima), [llama.cpp](https://github.com/ggml-org/llama.cpp)

## Configuration

Config in `~/.config/muthr/`:

- `llama/presets/*.ini` — context sizes, threading, model paths
- `lima/templates/*.yaml` — VM architecture, memory, container configs
- `lima/provision/*.sh` — boot scripts for OpenCode CLI and dependencies

Runtime state (PID files, logs, generated JSON) in `~/.cache/muthr/`.

## Installation

muthr is part of [tappunk/dotfiles](https://github.com/tappunk/dotfiles). Install it by following the [dotfiles instructions](https://github.com/tappunk/dotfiles).