pub enum StateComponentRole {
AttentionKeys,
AttentionValues,
CompressedLatent,
RotaryKeys,
Fixed(StateTensorRole),
}Expand description
Stable semantic identity for one independently managed runtime component.
Variants§
AttentionKeys
Ordinary attention keys.
AttentionValues
Ordinary attention values.
CompressedLatent
Head-independent compressed latent key/value state.
RotaryKeys
Rotary keys paired with compressed latent state.
Fixed(StateTensorRole)
One fixed-size or pooling tensor.
Implementations§
Source§impl StateComponentRole
impl StateComponentRole
Sourcepub fn stable_name(self) -> String
pub fn stable_name(self) -> String
Returns a stable checkpoint/runtime component name.
Trait Implementations§
Source§impl Clone for StateComponentRole
impl Clone for StateComponentRole
Source§fn clone(&self) -> StateComponentRole
fn clone(&self) -> StateComponentRole
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Copy for StateComponentRole
Source§impl Debug for StateComponentRole
impl Debug for StateComponentRole
Source§impl<'de> Deserialize<'de> for StateComponentRole
impl<'de> Deserialize<'de> for StateComponentRole
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl Eq for StateComponentRole
Source§impl Hash for StateComponentRole
impl Hash for StateComponentRole
Source§impl Ord for StateComponentRole
impl Ord for StateComponentRole
Source§fn cmp(&self, other: &StateComponentRole) -> Ordering
fn cmp(&self, other: &StateComponentRole) -> Ordering
1.21.0 (const: unstable) · Source§fn max(self, other: Self) -> Selfwhere
Self: Sized,
fn max(self, other: Self) -> Selfwhere
Self: Sized,
Compares and returns the maximum of two values. Read more
1.21.0 (const: unstable) · Source§fn min(self, other: Self) -> Selfwhere
Self: Sized,
fn min(self, other: Self) -> Selfwhere
Self: Sized,
Compares and returns the minimum of two values. Read more
Source§impl PartialEq for StateComponentRole
impl PartialEq for StateComponentRole
Source§impl PartialOrd for StateComponentRole
impl PartialOrd for StateComponentRole
Source§impl Serialize for StateComponentRole
impl Serialize for StateComponentRole
impl StructuralPartialEq for StateComponentRole
Auto Trait Implementations§
impl Freeze for StateComponentRole
impl RefUnwindSafe for StateComponentRole
impl Send for StateComponentRole
impl Sync for StateComponentRole
impl Unpin for StateComponentRole
impl UnsafeUnpin for StateComponentRole
impl UnwindSafe for StateComponentRole
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more