Struct Chain 

pub struct Chain { /* private fields */ }

Applies a sequence of logit filters in series.

Implementations

impl Chain

pub fn new() -> Self

Create an empty logits filter chain.

An empty chain returns input logits unmodified.

pub fn append<F: LogitsFilter + 'static>(self, filter: F) -> Self

Add a new filter to the chain.

pub fn temperature(self, temp: f32) -> Self

Add a temperature filter to the chain. See Temperature.

pub fn top_p(self, p: f32) -> Self

Add a top-P (nucleus sampling) filter to the chain. See TopP.

pub fn top_k(self, k: usize) -> Self

Add a top-K filter to the chain. See TopK.

Trait Implementations

impl Default for Chain

fn default() -> Self

Returns the “default value” for a type.

impl LogitsFilter for Chain

fn filter(&self, logits: Logits, prev_tokens: &[TokenId]) -> Logits

Filter the model’s output and return the modified logits.