Skip to main content

greedy_generate

Function greedy_generate 

Source
pub fn greedy_generate(
    engine: &mut dyn InferenceEngine,
    text: &str,
    max_len: usize,
) -> Result<Vec<i64>>
Expand description

The greedy single-row decode loop (model.generate + tokens.decode parity). Empty input (only the trailing EOS) short-circuits to no tokens, exactly like the reference loader.