Struct llama_cpp_2::context::sample::Sampler

pub struct Sampler<'grammar> { /* private fields */ }

👎Deprecated since 0.1.32: this does not scale well with many params and does not allow for changing of orders.

struct to hold params for sampling

Implementations

impl<'grammar> Sampler<'grammar>

pub fn new(llama_token_data_array: LlamaTokenDataArray) -> Self

👎Deprecated since 0.1.32: this does not scale well with many params and does not allow for changing of orders.

Create a new sampler.

pub fn with_grammar(self, grammar: &'grammar mut LlamaGrammar) -> Self

👎Deprecated since 0.1.32: this does not scale well with many params and does not allow for changing of orders.

Set the grammar for sampling.

pub fn with_temperature(self, temperature: f32) -> Self

👎Deprecated since 0.1.32: this does not scale well with many params and does not allow for changing of orders.

Set the temperature for sampling.

let _sampler = Sampler::new(LlamaTokenDataArray::new(vec![LlamaTokenData::new(LlamaToken(0), 0.0, 0.0)], false))
    .with_temperature(0.5);

Trait Implementations

impl<'grammar> Debug for Sampler<'grammar>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.