Skip to main content

params_fit

Function params_fit 

Source
pub unsafe fn params_fit(
    path_model: *const c_char,
    mparams: *mut llama_model_params,
    cparams: *mut llama_context_params,
    tensor_split: *mut f32,
    tensor_buft_overrides: *mut llama_model_tensor_buft_override,
    margins: *mut usize,
    n_ctx_min: u32,
    log_level: ggml_log_level,
) -> llama_params_fit_status
Expand description

Auto-fit model and context parameters for available memory.

ยงSafety

All pointers must be valid.