Skip to main content

load_mla_engine_from_path

ferrox_models::engine_factory

Function load_mla_engine_from_path 

Source 
pub fn load_mla_engine_from_path(path: &Path) -> Result<ServedEngine, LoadError>
Expand description

Open a DeepSeek-2 / Mistral-4 GGUF and build ServedEngine::Mla.