rivvend 0.0.4

Rivven broker server with Raft consensus and SWIM membership
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113

# rivvend

The Rivven broker server daemon.

## Features

- **Native Protocol** - High-performance binary protocol
- **HTTP Gateway** - REST API for management
- **Sticky Partitioner** - Kafka 2.4+ style partitioning for optimal throughput
- **Replication** - Multi-node replication with Raft consensus
- **Authentication** - SCRAM-SHA-256, mTLS, API keys
- **Authorization** - Cedar policy engine
- **Dashboard** - Leptos/WASM web UI (embedded when built with `--features dashboard`)

## Installation

```bash
# Build from source (without dashboard)
cargo build -p rivvend --release

# Build with embedded dashboard
# First, build the dashboard assets:
cd crates/rivven-dashboard
trunk build --release
cp -r dist/* ../rivvend/static/
cd ../..

# Then build the server with dashboard feature:
cargo build -p rivvend --release --features dashboard

# Run the server
./target/release/rivvend --data-dir ./data
# Dashboard available at http://localhost:8080/
```

**Note**: The dashboard requires building with the `dashboard` feature, which embeds the WASM assets compiled by trunk. See [rivven-dashboard README](../rivven-dashboard/README.md) for details.

## Message Partitioning

Rivven uses **sticky partitioning** (Kafka 2.4+ compatible):

| Message Type | Strategy | Behavior |
|:-------------|:---------|:---------|
| With key | Murmur2 hash | Same key → same partition |
| Without key | Sticky batching | Batches to one partition, rotates periodically |
| Explicit partition | Direct | Uses specified partition |

Configure via CLI:
```bash
rivvend --partitioner-batch-size 16384 --partitioner-linger-ms 100
```

Or environment variables:
```bash
export RIVVEN_PARTITIONER_BATCH_SIZE=16384
export RIVVEN_PARTITIONER_LINGER_MS=100
```

## Configuration

```yaml
# rivven.yaml
server:
  bind_address: "0.0.0.0:9092"
  http_port: 8080

storage:
  data_dir: /var/lib/rivven
  segment_bytes: 1073741824  # 1GB

cluster:
  node_id: 1
  peers:
    - "node2.rivven:9093"
    - "node3.rivven:9093"

auth:
  enabled: true
  mechanism: scram-sha-256

tls:
  enabled: true
  cert_file: /etc/rivven/server.crt
  key_file: /etc/rivven/server.key
```

## CLI Options

```bash
rivvend --help

USAGE:
    rivvend [OPTIONS]

OPTIONS:
    -c, --config <FILE>    Configuration file path
    -d, --data-dir <DIR>   Data directory
    -b, --bind <ADDR>      Bind address [default: 0.0.0.0:9092]
    -h, --help             Print help
    -V, --version          Print version
```

## Metrics

The server exposes Prometheus metrics on the HTTP port:

```bash
curl http://localhost:8080/metrics
```

## License

See root [LICENSE](../../LICENSE) file.