Skip to main content

Module models

Module models 

Source
Expand description

Model management commands for all model types: embeddings, rerankers, and LLMs.

Supports listing, installing, and removing models for semantic search, reranking, and local LLM inference.

Structs§

InstalledModel
Information about an installed model
ModelsArgs
Model management commands
ModelsInstallArgs
ModelsListArgs
ModelsRemoveArgs
ModelsVerifyArgs

Enums§

ClipModel
CLIP models available for installation
EmbeddingModel
Local embedding models available for installation
LlmModel
Known LLM models available for installation
ModelType
ModelsCommand
NerModel
NER models available for installation
RerankerModel
Local reranker models available for installation
WhisperModel
Whisper models - now using Candle with auto-download from HuggingFace No manual installation needed, kept for backwards compatibility

Functions§

default_enrichment_model
Get the default LLM model for enrichment
get_installed_model_path
Get the path to an installed model, or None if not installed
handle_models
Handle the models command
handle_models_install
Handle model installation
handle_models_list
Handle listing models
handle_models_remove
Handle model removal
handle_models_verify
Handle model verification