Skip to main content

split_model

Function split_model 

Source
pub fn split_model(
    model_path: &Path,
    topology_path: &str,
    worker: Option<&str>,
    output: &Path,
) -> Result<()>
Expand description

Split a model into per-worker bundles.

Each bundle contains a reduced safetensors file with only the worker’s assigned tensors, a matching index file, and the worker’s topology.