onde-cli 0.3.1

Terminal UI for signing up, signing in, and managing your Onde Inference account.
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226

<p align="center">
  <img src="https://raw.githubusercontent.com/ondeinference/onde/main/assets/onde-inference-logo.svg" alt="Onde Inference" width="80">
</p>

<h1 align="center">onde</h1>

<p align="center">
  <strong>A terminal app for managing <a href="https://ondeinference.com/">Onde Inference</a> apps and fine-tuning models locally.</strong><br>
  Sign in, assign models, and train adapters without bouncing between browser tabs.
</p>

<p align="center">
  <a href="https://ondeinference.com"><img src="https://img.shields.io/badge/ondeinference.com-235843?style=flat-square&labelColor=17211D" alt="Website"></a>
  <a href="https://pypi.org/project/onde-cli/"><img src="https://img.shields.io/pypi/v/onde-cli?style=flat-square&labelColor=17211D&color=235843" alt="PyPI"></a>
  <a href="https://www.npmjs.com/package/@ondeinference/cli"><img src="https://img.shields.io/npm/v/@ondeinference/cli?style=flat-square&labelColor=17211D&color=235843" alt="npm"></a>
  <a href="https://pub.dev/packages/onde_cli"><img src="https://img.shields.io/pub/v/onde_cli?style=flat-square&labelColor=17211D&color=235843" alt="pub.dev"></a>
  <a href="https://www.nuget.org/packages/Onde.Cli"><img src="https://img.shields.io/nuget/v/Onde.Cli?style=flat-square&labelColor=17211D&color=235843" alt="NuGet"></a>
  <a href="https://crates.io/crates/onde-cli"><img src="https://img.shields.io/crates/v/onde-cli?style=flat-square&labelColor=17211D&color=235843" alt="Crates.io"></a>
  <a href="https://github.com/ondeinference/onde-cli/blob/main/LICENSE"><img src="https://img.shields.io/badge/license-MIT%20%2F%20Apache--2.0-235843?style=flat-square&labelColor=17211D" alt="License"></a>
</p>

<br>

<p align="center">
  <img src="https://raw.githubusercontent.com/ondeinference/onde-cli/main/assets/screenshot.png" alt="onde CLI app list and model assignments" width="720">
</p>

<br>

---

## Install

```sh
pip install onde-cli
```

That installs the native `onde` binary for your platform. No compiler setup, no Node.js, no extra runtime to babysit. For package docs and the full install matrix, see <https://ondeinference.com/cli>.

## What you get

Run:

```sh
onde
```

and you'll get a full terminal UI where you can:

- sign up or sign in
- create and rename apps
- assign models to apps
- fine-tune supported Qwen models locally
- merge adapters and export GGUF files

If you prefer doing this work in a terminal instead of a browser, that's the whole point.

## Keyboard shortcuts

### Auth screen

| Key | Action |
|---|---|
| `Tab` | Move between fields |
| `Enter` | Submit |
| `Ctrl+L` | Switch to sign in |
| `Ctrl+N` | Switch to create account |
| `Ctrl+C` | Quit |

### Apps list

| Key | Action |
|---|---|
| `↑` `↓` | Move through apps |
| `Enter` | Open app details |
| `n` | Create a new app |
| `s` | Sign out |
| `Ctrl+C` | Quit |

### App detail

| Key | Action |
|---|---|
| `m` | Assign or change model |
| `r` | Rename app |
| `s` | Sign out |
| `Esc` | Back to apps list |

### Model picker

| Key | Action |
|---|---|
| `↑` `↓` | Move through models |
| `Enter` | Assign selected model |
| `Esc` | Cancel |

### Fine-tuning

| Key | Action |
|---|---|
| `↑` `↓` | Move through models |
| `f` | Open fine-tune config for the selected model |
| `m` | Merge adapter into base model |
| `g` | Export merged model to GGUF |

## Fine-tuning

`onde` can fine-tune Qwen2, Qwen2.5, and Qwen3 safetensors models with LoRA.

Training runs locally:
- on Metal for Apple Silicon
- on CPU everywhere else

No cloud training job. No Python environment. No notebook setup spiral.

If you want the short version of what happens inside the model at inference time, Onde also has a plain-English note on the [forward pass](https://ondeinference.com/forward-pass).

### Supported base models

| Model | Size |
|---|---|
| `Qwen/Qwen3-0.6B` | ~1.2 GB |
| `Qwen/Qwen2.5-1.5B-Instruct` | ~3.0 GB |
| `Qwen/Qwen3-1.7B` | ~3.4 GB |
| `Qwen/Qwen3-4B` | ~8.0 GB |

Only safetensors models can be fine-tuned. GGUF models are already quantized, so this pipeline doesn't use them as training inputs.

### Training data format

Use one JSON object per line. Each object needs a `text` field containing the full conversation in Qwen's chat template.

```jsonl
{"text": "<|im_start|>user\nWhat is the boiling point of water?<|im_end|>\n<|im_start|>assistant\n100°C at sea level.<|im_end|>"}
{"text": "<|im_start|>user\nWhat about at high altitude?<|im_end|>\n<|im_start|>assistant\nLower, around 90°C at 3000 m.<|im_end|>"}
```

### Running a fine-tune

1. Open the Models tab.
2. Pick a safetensors model with `↑` / `↓`.
3. Press `f`.
4. Set your training data path, LoRA rank, epochs, and learning rate.
5. Start training.

Default values:
- LoRA rank: `8`
- Epochs: `3`
- Learning rate: `0.0001`

As a rough reference, a rank-8 adapter for the 0.6B model is about 1.5 MB.

### After training

Once the run finishes:

- press `m` to merge the adapter into the base weights
- press `g` to export the merged model to GGUF

The exported file loads directly in the [Onde SDK](https://ondeinference.com/sdk) for on-device AI inference.

## Other ways to install

| Method | Command |
|---|---|
| npm | `npm install -g @ondeinference/cli` |
| Homebrew | `brew install ondeinference/homebrew-tap/onde` |
| uv | `uv tool install onde-cli` |
| Dart pub | `dart pub global activate onde_cli` |
| .NET tool | `dotnet tool install --global Onde.Cli` |
| Cargo | `cargo install onde-cli` |

### Build from source

```sh
git clone https://github.com/ondeinference/onde-cli
cd onde-cli
cargo build --release
./target/release/onde
```

## Platform support

Prebuilt native binaries are available for:

| Platform | Architecture |
|---|---|
| macOS | arm64, x64 |
| Linux (glibc) | arm64, x64 |
| Windows | arm64, x64 |

## Debug logs

Logs are written to `~/.cache/onde/debug.log`.

The app uses the terminal screen directly while the TUI is open, so logs go to the file instead of printing over the interface.

## Related SDKs

| SDK | Install |
|---|---|
| [Swift SDK](https://github.com/ondeinference/onde-swift) | Swift Package Manager |
| [Flutter SDK](https://pub.dev/packages/onde_inference) | `flutter pub add onde_inference` |
| [React Native SDK](https://www.npmjs.com/package/@ondeinference/react-native) | `npm i @ondeinference/react-native` |
| [Rust crate](https://crates.io/crates/onde) | `cargo add onde` |

## Source and issues

This package ships a prebuilt native binary. The source code lives here:

[github.com/ondeinference/onde-cli](https://github.com/ondeinference/onde-cli)

Bug reports and feature requests should go there too.

## License

Dual-licensed under **MIT** and **Apache 2.0**.

- [MIT License](https://github.com/ondeinference/onde-cli/blob/main/LICENSE-MIT)
- [Apache License 2.0](https://github.com/ondeinference/onde-cli/blob/main/LICENSE-APACHE)

---

## Copyright

© 2026 [Onde Inference](https://ondeinference.com) (Splitfire AB).