Struct LlamaStateSeqFlags 

pub struct LlamaStateSeqFlags(/* private fields */);

Flags for state sequence operations.

These flags control what parts of the state are included when saving/restoring sequence state.

Implementations

impl LlamaStateSeqFlags

pub const PARTIAL_ONLY: LlamaStateSeqFlags

Work only with partial states, such as SWA KV cache or recurrent cache (e.g. Mamba).

This flag is useful when you only want to save/restore the recurrent state without affecting the KV cache.

pub const fn empty() -> LlamaStateSeqFlags

Create an empty flags set.

pub const fn bits(&self) -> u32

Get the raw flags value.

pub const fn contains(&self, other: LlamaStateSeqFlags) -> bool

Check if a flag is set.

Trait Implementations

impl Clone for LlamaStateSeqFlags

fn clone(&self) -> LlamaStateSeqFlags

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LlamaStateSeqFlags

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for LlamaStateSeqFlags

fn default() -> Self

Returns the “default value” for a type.

impl PartialEq for LlamaStateSeqFlags

fn eq(&self, other: &LlamaStateSeqFlags) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for LlamaStateSeqFlags

impl Eq for LlamaStateSeqFlags

impl StructuralPartialEq for LlamaStateSeqFlags