Skip to main content

Module registry

Module registry 

Source
Expand description

Engine Registry

Manages the collection of available and installed llama.cpp engines, tracks compatibility with hardware capabilities, and maintains metadata about each engine.

Structs§

EngineInfo
Information about a specific llama.cpp engine
EngineRegistry
Manages the registry of available and installed engines

Enums§

AccelerationType
Types of hardware acceleration supported by llama.cpp engines
EngineStatus
Status of an engine installation