Skip to main content

Crate blazen_model_cache

Crate blazen_model_cache 

Source
Expand description

Shared model download and cache layer for Blazen local-inference backends.

Provides ModelCache for downloading and caching ML models from HuggingFace Hub. Designed to be shared by all local-inference backends (fastembed, mistral.rs, whisper.cpp, etc.).

Structs§

ModelCache
Local cache for ML models downloaded from HuggingFace Hub.

Enums§

CacheError
Errors that can occur during model cache operations.

Traits§

ProgressCallback
Callback trait for receiving download progress updates.