Skip to main content

generate_local_candle

Function generate_local_candle 

Source
pub fn generate_local_candle(
    sys: &str,
    user: &str,
    stop: Option<Vec<String>>,
    params: &CandleRunParams,
) -> Result<String>
Expand description

Run a minimal local Candle generation using HF Hub llama-family checkpoints. Returns the generated assistant text (without the prompt).