Function llama_cpp_sys::llama_sample_entropy

source ·
pub unsafe extern "C" fn llama_sample_entropy(
    ctx: *mut llama_context,
    candidates_p: *mut llama_token_data_array,
    min_temp: f32,
    max_temp: f32,
    exponent_val: f32
)
Expand description

@details Dynamic temperature implementation described in the paper https://arxiv.org/abs/2309.02772.