Skip to main content

baseRT_context_window_fits

Function baseRT_context_window_fits 

Source
pub unsafe extern "C" fn baseRT_context_window_fits(
    model_paths: *const *const c_char,
    n_models: c_int,
    max_batch: c_int,
    kv_bits: c_int,
    paged_kv: c_int,
    window: c_int,
) -> c_int
Expand description

1 = the window fits the co-resident set, 0 = it does not, -1 = unknown.