Skip to main content

Module data

ik_llama_cpp_2::token

Module data 

Source
Expand description

Safe wrapper around llama_token_data.

Structsยง

LlamaTokenData
A transparent wrapper around llama_token_data (a token id + its logit and probability).