Skip to main content

runtime_for_id

Function runtime_for_id 

Source
pub fn runtime_for_id(id: &str) -> &'static str
Expand description

The runtime a model id goes to when no --runtime names one: a GGUF repository to llama.cpp, an MLX conversion to MLX, anything else to baseRT.