Structs§
- Chat
Model - A chat model loaded by ModelRegistry.
- Model
Registry - A registry for loading models compatible with the
llama.cppAPIs. - Text
Embedding Model - A text embedding model loaded by ModelRegistry.
Enums§
- Error
- Error that occurs when working with a model.
Functions§
- cosine_
distance - Returns the cosine distance between two vectors.