Function llama_cpp_sys_2::llama_beam_search
source · pub unsafe extern "C" fn llama_beam_search(
ctx: *mut llama_context,
callback: llama_beam_search_callback_fn_t,
callback_data: *mut c_void,
n_beams: usize,
n_past: i32,
n_predict: i32
)Expand description
@details Deterministically returns entire sentence constructed by a beam search. @param ctx Pointer to the llama_context. @param callback Invoked for each iteration of the beam_search loop, passing in beams_state. @param callback_data A pointer that is simply passed back to callback. @param n_beams Number of beams to use. @param n_past Number of tokens already evaluated. @param n_predict Maximum number of tokens to predict. EOS may occur earlier.