chasm-cli 2.0.0

Universal chat session manager - harvest, merge, and analyze AI chat history from VS Code, Cursor, and other editors
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43

# LocalAI Setup


Run any GGUF/GGML model locally with LocalAI and chat through Chasm.

## Prerequisites


- [LocalAI](https://localai.io/) installed (Docker recommended)

## Installation


=== "Docker"

    ```bash
    docker run -p 8080:8080 --name localai \
      -v $PWD/models:/models \
      localai/localai:latest
    ```

=== "Binary"

    Download from [LocalAI releases](https://github.com/mudler/LocalAI/releases).

## Usage with Chasm


```bash
# Interactive chat

chasm run localai

# Custom endpoint

LOCALAI_URL=http://localhost:8080 chasm run localai
```

## Configuration


| Variable | Default | Description |
|---|---|---|
| `LOCALAI_URL` | `http://localhost:8080` | LocalAI server URL |

## Tips


- LocalAI supports GGUF, GGML, and other model formats
- Deploy with Docker for easy model management
- Provides OpenAI-compatible API endpoints