Skip to main content

load_policy

Function load_policy 

Source
pub fn load_policy(
    quant_format: &str,
    gpu_name: Option<&str>,
    path: Option<&Path>,
    gpu_uuid: Option<&str>,
) -> QStarPolicy
Expand description

The split policy to serve quant_format with on this card.

Total, unlike the two loaders above: every path that ends in “we do not know” ends in the unbenchmarked default, a fixed cap of one fetch per layer per step.