pub struct QuantTensor<'a> {
pub format: QuantFormat,
pub shape: Vec<usize>,
pub data: Cow<'a, [u8]>,
}Expand description
A quantized tensor’s packed bytes, exactly as stored in the file.
Fields§
§format: QuantFormatBlock format of data.
shape: Vec<usize>Logical shape, HF layout ([out_features, in_features] for weights).
data: Cow<'a, [u8]>The raw block stream — mmap-backed when served verbatim, owned when the source had to reorder rows (GGUF RoPE de-permutation).
Auto Trait Implementations§
impl<'a> Freeze for QuantTensor<'a>
impl<'a> RefUnwindSafe for QuantTensor<'a>
impl<'a> Send for QuantTensor<'a>
impl<'a> Sync for QuantTensor<'a>
impl<'a> Unpin for QuantTensor<'a>
impl<'a> UnsafeUnpin for QuantTensor<'a>
impl<'a> UnwindSafe for QuantTensor<'a>
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more