Struct ActiveSequence 

pub struct ActiveSequence { /* private fields */ }

A sequence that is actively being built, with the ability to add tokens and commit to hashes TODO: reuse tokens

Implementations

impl ActiveSequence

Auto-generated by derive_getters::Getters.

pub fn unique_blocks(&self) -> &Vec<UniqueBlock>

Get field unique_blocks from instance of ActiveSequence.

pub fn tokens(&self) -> &TokenBlockSequence

Get field tokens from instance of ActiveSequence.

pub fn block_size(&self) -> usize

Get field block_size from instance of ActiveSequence.

pub fn max_output_tokens(&self) -> usize

Get field max_output_tokens from instance of ActiveSequence.

pub fn generated_tokens(&self) -> usize

Get field generated_tokens from instance of ActiveSequence.

pub fn already_generated_tokens(&self) -> usize

Get field already_generated_tokens from instance of ActiveSequence.

pub fn num_input_tokens(&self) -> usize

Get field num_input_tokens from instance of ActiveSequence.

pub fn creation_signal(&self) -> &Option<MoveBlock>

Get field creation_signal from instance of ActiveSequence.

pub fn enable_prefix_caching(&self) -> bool

Get field enable_prefix_caching from instance of ActiveSequence.

impl ActiveSequence

pub fn new( tokens: Vec<u32>, max_output_tokens: usize, block_size: Option<usize>, enable_prefix_caching: bool, ) -> Self

Create a new ActiveSequence instance with the provided tokens

pub fn extra_tokens(&self) -> u32

pub fn len(&self) -> usize

pub fn is_empty(&self) -> bool

pub fn take_creation_signal(&mut self) -> Option<MoveBlock>

pub fn block_hashes(&self) -> Vec<u64>

pub fn new_with_signal( tokens: Vec<u32>, max_output_tokens: usize, block_size: Option<usize>, enable_prefix_caching: bool, ) -> (Self, Option<MoveBlock>)

Create a new ActiveSequence instance and return the creation signal

pub fn push(&mut self, token: u32) -> Option<Vec<MoveBlock>>

Push a token to the sequence

pub fn generate(&mut self) -> Vec<MoveBlock>

Generate a random token, push it to the sequence, and increment generation count.

This function:

• Generates a random token and adds it to the current sequence
• Acquires a new partial block if needed or promotes an existing partial block to a full block
• Returns appropriate signals for the KvManager to process

Panics

Calling this function when max_output_tokens has already been reached will cause a panic. Always check generated_tokens < max_output_tokens before calling this method.

pub fn free_signal(&self) -> Vec<MoveBlock>

Free all blocks, generating appropriate signals for each block type

pub fn reset_with_signal(&mut self) -> Vec<MoveBlock>

Reset the sequence to its initial state and return the free signals from freeing current blocks

pub fn pop(&mut self)

Pops last token in the sequence.

Trait Implementations

impl Debug for ActiveSequence

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.