Skip to main content

llama_sample_softmax

Function llama_sample_softmax 

Source
pub unsafe extern "C" fn llama_sample_softmax(
    ctx: *mut llama_context,
    candidates: *mut llama_token_data_array,
)
Expand description

@details Sorts candidate tokens by their logits in descending order and calculate probabilities based on logits.