Struct StopSequenceDecoder 

pub struct StopSequenceDecoder { /* private fields */ }

A Sequence for decoding a stream of token ids into text and detecting stop sequences. A stop sequence is either a matching token_id or a sequence of texts/strings which match. Matches happen first at the token-level, then at the sequence-level. Hidden takes precedence over visible. For example, if you put the same token_id in both stop_token_ids_visible and stop_token_ids_hidden, the token_id will be treated as hidden.

Implementations

impl StopSequenceDecoder

pub fn builder(tokenizer: Tokenizer) -> StopSequenceDecoderBuilder

Builder object for configurating a StopSequenceDecoder

pub fn append_token_id( &mut self, token_id: TokenIdType, ) -> Result<SequenceDecoderOutput>

Add a token_id to the sequence and return the SequenceDecoderOutput

pub fn is_empty(&self) -> bool

pub fn len(&self) -> usize

pub fn is_complete(&self) -> bool

pub fn close(&mut self)

Trait Implementations

impl Debug for StopSequenceDecoder

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.