Skip to main content

Module lora

Module lora 

Source
Expand description

Startup LoRA adapter loader and validator.

G4 supports PEFT-style startup adapters with:

  • adapter_config.json
  • adapter_model.safetensors

The production server registry uses the validated metadata here. Actual hot-loading, GGUF LoRA, and multi-adapter composition are intentionally out of scope.

Structs§

ActiveLoraAdapter
LoraAdapterConfig
LoraTensorPair
RuntimeLoraAdapter
RuntimeLoraLinear
StartupLoraAdapter
StartupLoraSpec

Functions§

default_lora_model_id
load_runtime_lora_adapter
load_startup_lora_adapter
load_startup_lora_adapters
render_lora_model_id