pub enum KvStateStorage {
F16 {
state: StateId,
},
Int8PerTokenHeadF32ScaleV1 {
payload_state: StateId,
scale_state: StateId,
},
}Expand description
Semantic K/V storage declared by the family, never inferred from a name or from a provider’s private buffers. Each referenced state belongs to the same sequence and participates in the ordinary allocation/completion lifecycle.
Variants§
Implementations§
Source§impl KvStateStorage
impl KvStateStorage
pub const fn format(&self) -> KvStorageFormat
pub fn payload_state(&self) -> &StateId
pub fn scale_state(&self) -> Option<&StateId>
Trait Implementations§
Source§impl Clone for KvStateStorage
impl Clone for KvStateStorage
Source§fn clone(&self) -> KvStateStorage
fn clone(&self) -> KvStateStorage
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for KvStateStorage
impl Debug for KvStateStorage
Source§impl<'de> Deserialize<'de> for KvStateStorage
impl<'de> Deserialize<'de> for KvStateStorage
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl Eq for KvStateStorage
Source§impl PartialEq for KvStateStorage
impl PartialEq for KvStateStorage
Source§impl Serialize for KvStateStorage
impl Serialize for KvStateStorage
impl StructuralPartialEq for KvStateStorage
Auto Trait Implementations§
impl Freeze for KvStateStorage
impl RefUnwindSafe for KvStateStorage
impl Send for KvStateStorage
impl Sync for KvStateStorage
impl Unpin for KvStateStorage
impl UnsafeUnpin for KvStateStorage
impl UnwindSafe for KvStateStorage
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more