New in 3.0: a redesigned browser workspace. Every feature is still there, but each control appears only when you need it, and the Models view now loads the full ranked catalog. See what changed →
Let Sparky check your rig
RigSpark keeps the first question simple: will this model actually run here? The answer comes from a curated offline catalog and your detected hardware, not from a download you have already waited for.
1. Install RigSpark
Homebrew on macOS or Linux:
On Windows and other platforms, download a
prebuilt archive,
extract it, and add the folder to PATH. Keep rigspark, llmup, and
rigspark-gui together.
The RigSpark binaries need no Node.js, Python, or compiler. Inference backends have their own requirements.
If Sparky helps you, please consider sponsoring the project: https://buymeacoffee.com/shashanksw9
Cargo, checksums, unsigned macOS archives, and upgrades → · Docker caveats →
2. Sparky sizes up your hardware
Start with advice. It is deterministic, works offline, and does not require an inference backend:
recommendranks the catalog for this machine.can-runchecks one model before you download it.catalog --alllets you browse the bundled model data.
Use --json for automation and --accessible for screen-reader-friendly
output. llmup remains a compatibility alias.
3. Read the face: yes, slow, or no
| Verdict | What Sparky means |
|---|---|
| yes | The model fits with the required headroom. |
| slow | It fits, but the expected experience may be constrained. |
| no | It does not safely fit the detected memory budget. |
Every verdict includes the reason. When RigSpark cannot source a figure, it says
unknown rather than inventing one. Throughput ranges are estimates, not
benchmarks.
4. Pick a model, verify it, and start
Once you have a fit, move from advice to a running model:
RigSpark supports:
- Ollama — recommended default and managed child process
- llama.cpp — native local serving
- MLX — Apple Silicon
- LM Studio — attach to an already running server
- BitNet — Microsoft's I2_S weights on CPU, using your compiled bitnet.cpp server
Managed weights pass an integrity check before serving. Servers bind to
127.0.0.1 by default.
For Microsoft's official BitNet b1.58 2B-4T:
Build the server using Microsoft's instructions. On Apple Silicon, use the tested pinned build and ARM patch; unmodified builds can produce invalid output or crash, and BLAS must be disabled. Stock llama.cpp cannot load this I2_S artifact. RigSpark downloads and verifies the weights, not the runtime. Keep the variable set for chat, doctor and shutdown. The initial integration is CPU-only; speed and KV-memory estimates stay unknown. See the per-model benchmark reports for the recorded BitNet chat results, methodology, and limitations.
Backend setup and lifecycle details →
5. Continue in the browser workspace
Choose a model, inspect the same hardware verdicts, chat, and use agents, skills, and MCP tools from the loopback-only browser workspace.
- One model chip in the top bar holds the model, runtime, harness, and agent pickers.
- Models lists the whole ranked catalog with search, Runs well / Slow / Won't fit filters, and a Fit settings popover for context and KV cache.
- The inspector (⌘I, or click Sparky) shows live memory, CPU, disk, and the latest call's token usage. Sparky's mood follows real RAM pressure.
- Light and dark themes, with ⌘1–⌘5 to switch views.
Local chat stays on your machine. Cloud harnesses and external tools can send data to their own providers, so RigSpark keeps those boundaries visible.
Browser workspace, agents, and tools →
6. Let Sparky create images and short videos
RigSpark can orchestrate open-weight image and video models through your own ComfyUI installation.
Start ComfyUI on its default loopback address, 127.0.0.1:8188. RigSpark
downloads pinned weights, verifies their SHA-256 digest, installs only its
built-in local workflows, and refuses paid Partner API nodes. Generation speed
stays unknown when no defensible measurement is available.
In rigspark gui, switch the composer from Text to Image or Video.
Generated media renders inline and is never sent to the language model.
For UI/UX mockups, select ming-image:ming_image_0.1_design_int8_convrot under Models → Image → Use in Chat, then generate in Image mode. This exact 25.94 GB weight pairing was tested with ComfyUI 0.38.0 on a 36 GiB Apple Silicon Mac. Other Ming variants remain fit-only; NVIDIA/CUDA and peak inference memory are not certified. Generated lettering can be garbled.
Image and video generation specification →
Why the answers are trustworthy
- Offline advice. Recommendation commands use a bundled, curated catalog and make no network calls.
- Honest unknowns. Missing bandwidth, model geometry, or measurements stay
visibly
unknown. - Fail-closed integrity. Managed weights must match their catalog digest, or a documented size-floor fallback, before RigSpark serves them.
- Loopback by default. Local servers listen on
127.0.0.1, not the public network. - Reproducible decisions. The same hardware and catalog produce the same recommendation.
- One adapter boundary. Ollama, llama.cpp, MLX, LM Studio, and BitNet sit behind the same runtime lifecycle and safety gates.
Update the catalog when you choose
Catalog updates are explicit; recommendations and normal startup remain offline.
RigSpark verifies the signed catalog before activating it atomically. An invalid signature, incompatible schema, or network failure leaves the current snapshot unchanged. Recovery falls back through the previous verified snapshot and then the bundled catalog, with visible warnings.
New models arrive weekly. A scheduled pipeline admits every new Ollama library
model whose facts it can read from the shipped artifact (size, digest, context,
architecture, open license), plus Comfy-Org image and video releases, and
publishes a signed catalog once the quality gate passes. These entries are marked
auto-sourced, keep fail-closed digest verification, and show unknown for
anything that could not be sourced. Image and video models without a built-in
workflow yet get a fit verdict and are labelled workflow coming.
In the terminal UI, m cycles the same 1, 2 and 3 month windows; the browser
workspace has a Released in selector.
rigspark catalog --refresh is a maintainer preview of enrichment against the
bundled registry snapshot; it does not install a published catalog.
Catalog provenance, trust, and recovery →
A 20-second tour
The tour runs rigspark recommend, shows models that do and do not fit, then
opens the same verdicts and a local chat in rigspark gui.
Watch in 1080p with sound · Earlier demo on YouTube
Find your next command
| Goal | Command |
|---|---|
| Rank models for this machine | rigspark recommend |
| Check one model | rigspark can-run <model> |
| Diagnose hardware and runtimes | rigspark doctor |
| Browse text models | rigspark catalog --all |
| Browse image and video models | rigspark catalog --generation |
| Start a verified model | rigspark up <model> |
| Open the terminal UI | rigspark |
| Open the browser workspace | rigspark gui |
| Generate local media | rigspark generate |
| Stop the active model | rigspark down |
Run rigspark --help for the complete CLI.
Project map
crates/rigspark-core/— catalog, memory sizing, ranking, advice, and reportscrates/rigspark-runtime/— hardware detection, backend adapters, lifecycle, state, and harnessescrates/rigspark-gui/— loopback HTTP/SSE host and embedded browser clientcrates/rigspark-cli/— native CLI, terminal UI, and catalog maintenanceapps/desktop/src-tauri/— native desktop shell
Build from source
RigSpark is a Rust workspace pinned to Rust 1.98.1:
No Node.js or TypeScript tooling is part of the project.
Keep exploring
- Commands, custom context, and installed models
- Terminal UI
- How hardware advice works
- Scripting and exit codes
- FAQ and troubleshooting
- Development guide
- Project specification
- Changelog
Support RigSpark
RigSpark is free, MIT-licensed, and built in spare time. If it saved you a download that would never have run, you can buy me a coffee ☕.
Keywords: local LLM, run LLM locally, LLM hardware requirements, VRAM calculator, tokens per second, Ollama, llama.cpp, MLX, LM Studio, Rust CLI.
