Skip to main content

Module data_array

ik_llama_cpp_2::token

Module data_array 

Source
Expand description

A rusty equivalent of llama_token_data_array.

Structs§

LlamaTokenDataArray
A safe wrapper around llama_token_data_array — the candidate set consumed (and mutated) by sampling.