muthr 0.1.33

muthr is a zero-trust orchestrator that automates llama.cpp and Lima to run local AI agents. It controls inference via a host-based llama-server and spawns isolated Lima VMs for agent execution. Agents get full read-write access to your project workspace, but zero access to the host OS or SSH keys.

Architecture

1. llama-server on macOS, accelerated via Metal
2. limactl VMs provisioned per-project
3. opencode inside guest VMs, connecting over host.lima.internal

Prerequisites

macOS (Apple Silicon, ≥48GB RAM for 35B models), Lima, llama.cpp

[!NOTE] The ≥48GB RAM requirement applies to 35B models. Smaller models run on machines with less memory.

Usage

muthr                    # Show system status dashboard (default)
muthr --help             # List all subcommands
muthr init               # Clone specs from tappunk/muthr-specs
muthr download <source>  # Fetch GGUF model from HuggingFace

muthr serve              # Start llama-server as a background daemon
muthr serve --foreground # Run in foreground
muthr stop               # Stop the engine
muthr list               # List available preset profiles

muthr up                 # Provision a Debian 13 VM for the current project
muthr ls                 # List all managed sandbox VMs
muthr down               # Stop the current sandbox
muthr delete             # Delete the active sandbox VM

muthr services start     # Launch MCP services VM
muthr services status
muthr services stop
muthr services restart   # Restart the MCP services VM
muthr services delete    # Delete the MCP services VM

muthr boot               # Full stack startup: inference engine + MCP services VM
muthr shutdown           # Graceful shutdown of all owned components

muthr config init        # Create muthr.toml config file
muthr config show        # Show resolved configuration

Configuration

Config in ~/.config/muthr/ (see muthr-specs for the full directory structure and examples):

• provider.d/llama-cpp/*.ini — presets (context sizes, threading, model paths)
• clients/opencode-config.json — template for OpenCode runtime config generation
• manifests/*.yaml — VM architecture, memory, container configs
• provision.d/*.sh — boot scripts for OpenCode CLI and dependencies

Runtime state (PID files, logs, generated JSON) in ~/.cache/muthr/.

Installation

muthr is available on crates.io and Homebrew.

Cargo

cargo install muthr

Homebrew

brew install tappunk/muthr/muthr