kproc-llm 0.7.0

Knowledge Processing library, using LLMs.
Documentation
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
To run the `simple` example with `llama.cpp` backend, use:

```bash
cargo run --example simple --features="llama.cpp-vulkan ollama simple-api" -- --llama-cpp "Who are you?"
```

To run the `simple` example with `ollama` backend, use:

```bash
cargo run --example simple --features="llama.cpp-vulkan ollama simple-api" -- --ollama "Who are you?"
```

To run the `simple` example with `simple-api` backend (assumes a local server, e.g. from llama-cpp), use:

```bash
cargo run --example simple --features="llama.cpp-vulkan ollama simple-api" -- --simple-api "Who are you?"
```