Crate llmvm_core_lib

Source
Expand description

The core components for llmvm.

Assumes the following responsibilities:

  • Sending generation requests to backends
  • Managing message threads
  • Model presets
  • Prompt templates
  • Projects

Modules§

error
generation
presets
prompts
service

Structs§

LLMVMCore
The llmvm core which handles sending generation requests to the backend, managing message threads, model presets, and prompt templates. Frontends request text generation by invoking the core.
LLMVMCoreConfig
Configuration structure for the llmvm core.

Type Aliases§

Result