Function llama_cpp_sys_2::llama_sample_apply_guidance

pub unsafe extern "C" fn llama_sample_apply_guidance(
    ctx: *mut llama_context,
    logits: *mut f32,
    logits_guidance: *mut f32,
    scale: f32
)

@details Apply classifier-free guidance to the logits as described in academic paper “Stay on topic with Classifier-Free Guidance” https://arxiv.org/abs/2306.17806 @param logits Logits extracted from the original generation context. @param logits_guidance Logits extracted from a separate context from the same model. Other than a negative prompt at the beginning, it should have all generated and user input tokens copied from the main context. @param scale Guidance strength. 1.0f means no guidance. Higher values mean stronger guidance.