Crate kproc_llm 

kproc-llm

kproc is a knowledge processing library. It is intended to help transform information into a knowledge graph. This library is part of the auKsys project.

kproc-llm is part of kproc, it provides a standardized interface to common LLM libraries. It currently support ollama and llama.cpp.

Development happens in the dev/1 branch.

Modules

candle

Interface with candle llm

prelude

prelude for kproc_llm, with common types, usually used with use kproc::prelude::*.

simple_api

Module for using with simple API (like llama-cpp-server).

template

Template module

Structs

ChatPrompt

Prompt for a chat session

GenerationPrompt

Prompt

Message

Message

Enums

Error

Error enum for kproc

Format

Format

Role

Speaker

Traits

LargeLanguageModel

LLM

Type Aliases

Result

Export Result type.

StringStream

String stream