pub struct BlockQuantizationSpec {
pub format_id: QuantizationFormatId,
pub logical_values_per_block: u32,
pub bytes_per_block: u32,
}Expand description
Self-contained fixed-size quantization blocks such as GGML/GGUF Q4_K and
Q6_K. Per-block scales, minima, and packed values are part of the opaque
block ABI identified by format_id; providers must not reinterpret these
bytes as the separate-scale QuantizationSpec representation.
Fields§
§format_id: QuantizationFormatId§logical_values_per_block: u32§bytes_per_block: u32Implementations§
Source§impl BlockQuantizationSpec
impl BlockQuantizationSpec
pub fn validate(&self) -> Result<(), VNextError>
Trait Implementations§
Source§impl Clone for BlockQuantizationSpec
impl Clone for BlockQuantizationSpec
Source§fn clone(&self) -> BlockQuantizationSpec
fn clone(&self) -> BlockQuantizationSpec
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for BlockQuantizationSpec
impl Debug for BlockQuantizationSpec
Source§impl<'de> Deserialize<'de> for BlockQuantizationSpec
impl<'de> Deserialize<'de> for BlockQuantizationSpec
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl Eq for BlockQuantizationSpec
Source§impl PartialEq for BlockQuantizationSpec
impl PartialEq for BlockQuantizationSpec
Source§impl Serialize for BlockQuantizationSpec
impl Serialize for BlockQuantizationSpec
impl StructuralPartialEq for BlockQuantizationSpec
Auto Trait Implementations§
impl Freeze for BlockQuantizationSpec
impl RefUnwindSafe for BlockQuantizationSpec
impl Send for BlockQuantizationSpec
impl Sync for BlockQuantizationSpec
impl Unpin for BlockQuantizationSpec
impl UnsafeUnpin for BlockQuantizationSpec
impl UnwindSafe for BlockQuantizationSpec
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more