ogenius 0.1.5

Lightweight AI inference server using HuggingFace models directly - a simpler alternative to Ollama
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45

# Ogenius API Reference

Ogenius provides an OpenAI-compatible API for seamless integration with existing tools, alongside custom endpoints for low-latency streaming and asset management.

## OpenAI Compatible Endpoints

### List Models
`GET /v1/models`

Returns a list of all models currently registered in the system (built-in + user-injected).

**Response:**
```json
{
  "object": "list",
  "data": [
    {
      "id": "qwen-2.5-1.5b",
      "object": "model",
      "created": 1677610602,
      "owned_by": "rusty-genius"
    }
  ]
}
```

### Chat Completions
`POST /v1/chat/completions`

*Note: Currently being implemented. Use the WebSocket interface for streaming completions.*

## Custom Endpoints

### WebSocket Chat (Streaming)
`GET /` (WebSocket upgrade on `--ws-addr`)

High-performance, low-latency streaming interface used by the Ogenius Web UI.

**Protocol:** JSON-based event stream.

## Configuration & Assets

Models are managed by the `facecrab` registry:
- **`manifest.toml`**: Static user extensions.
- **`registry.toml`**: Dynamic tracking of downloaded assets.