Granite CLI

🚧 🚧 🚧 UNDER CONSTRUCTION 🚧 🚧 🚧

A command-line tool for discovering, configuring, and launching Granite-powered local and remote AI workflows.

Quick Start

Install with the one-liner script

curl -fsSL https://raw.githubusercontent.com/IBM-granite-community/granite-cli/main/install.sh | bash

This script automatically:

• Downloads the latest prebuilt binary (when available for your platform)
• Falls back to cargo install if no binary exists
• Builds from source as a last resort

Environment variables:

Install from source

git clone https://github.com/IBM-granite-community/granite-cli.git
cd granite-cli
cargo install --path .

The binary will be placed in ~/.cargo/bin (or $CARGO_INSTALL_ROOT/bin if set).

Install on Termux

curl -fsSL https://raw.githubusercontent.com/IBM-granite-community/granite-cli/main/install.sh | bash

On Termux the script will:

• Use ~/bin as the default install directory (already on PATH)
• Detect the Termux environment and automatically install required packages (openssl, pkg-config, clang, perl, binutils)
• Configure the build to use Termux's system OpenSSL and gnu17 C standard

If building from source is required, the script handles all Termux-specific build configuration automatically.

Verify installation

granite-cli --help

Roadmap

Today, the project already supports:

• browsing a catalog of Granite models
• configuring models and providers
• checking provider health
• recommending models based on local hardware
• pulling model weights for supported local providers
• rendering output in the terminal, as plain text, JSON, and Markdown

The longer-term goal is for Granite CLI to become the control plane for Granite-based developer tooling: a single place to manage models, providers, capabilities, and launcher integrations for tools like coding assistants and agentic workflows.

Current direction

The project is currently focused on building a strong foundation in a few areas:

• Model management: catalog, search, recommendation, setup, and pull flows for Granite models
• Provider management: support for local and OpenAI-compatible providers, including health checks and model compatibility
• Capability architecture: describing higher-level Granite capabilities that can be attached to tools and workflows
• Launcher architecture: eventually launching external tools with Granite-aware configuration and overlays
• Multiple output modes: terminal-first UX with machine-readable output formats for scripting and automation

What the project wants to be

Granite CLI is aiming to become:

1. a developer-facing interface for working with Granite models and capabilities
2. a local setup and orchestration tool for providers like Ollama, LM Studio, llama.cpp, and compatible servers
3. a bridge layer between Granite model/capability definitions and downstream tools such as assistants, launchers, and IDE workflows
4. a repeatable automation surface that works well both interactively and in scripts/CI

Near-term themes

• improving CI and contributor workflows
• expanding provider support
• expanding model metadata and registry coverage
• building out TUI setup and browsing flows
• implementing capability and launcher architecture
• improving documentation and release automation

This repository is still under active construction. The architecture is taking shape, but some areas are intentionally incomplete while core foundations are being built.

Contributing

See CONTRIBUTING.md for full details. We follow a fork-and-PR workflow with DCO sign-off, and ask that all participants follow our Code of Conduct.