Crate kproc_llm 

kproc-llm

kproc is a knowledge processing library. It is intended to help transform information into a knowledge graph. This library is part of the auKsys project.

kproc-llm is part of kproc, it provides a standardized interface to common LLM libraries. It currently support ollama and llama.cpp.

Development happens in the dev/1 branch.

Modules

prelude

prelude for kproc_llm, with common types, usually used with use kproc::prelude::*.

simple_api

Module for using with simple API (like llama-cpp-server).

template

Template module

Structs

ChatPrompt

Prompt

GenerationPrompt

Prompt

Message

Message

Enums

Error

Export Error enum. Error enum for kproc

Format

Format

Role

Speaker

Traits

LargeLanguageModel

LLM

Type Aliases

Result

Export Result type.

StringStream

String stream