pub struct BlockIq3S { /* private fields */ }Trait Implementations§
impl Copy for BlockIq3S
Source§impl GgmlType for BlockIq3S
impl GgmlType for BlockIq3S
const DTYPE: GgmlDType = GgmlDType::Iq3S
const BLCK_SIZE: usize = QK_K
type VecDotType = BlockQ8K
fn to_float(xs: &[Self], ys: &mut [f32])
fn from_float(_xs: &[f32], _ys: &mut [Self])
Source§fn vec_dot(n: usize, xs: &[Self], ys: &[Self::VecDotType]) -> f32
fn vec_dot(n: usize, xs: &[Self], ys: &[Self::VecDotType]) -> f32
Dot product used as a building block for quantized mat-mul.
n is the number of elements to be considered.
Source§fn vec_dot_unopt(n: usize, xs: &[Self], ys: &[Self::VecDotType]) -> f32
fn vec_dot_unopt(n: usize, xs: &[Self], ys: &[Self::VecDotType]) -> f32
Generic implementation of the dot product without simd optimizations.
const DIRECT_COPY: bool = false
fn from_float_imatrix( _xs: &[f32], _ys: &mut [Self], _imatrix_weights: &[f32], _n_per_row: usize, )
fn direct_copy(_xs: &[f32], _ys: &mut [Self])
impl Pod for BlockIq3S
impl StructuralPartialEq for BlockIq3S
Auto Trait Implementations§
impl Freeze for BlockIq3S
impl RefUnwindSafe for BlockIq3S
impl Send for BlockIq3S
impl Sync for BlockIq3S
impl Unpin for BlockIq3S
impl UnsafeUnpin for BlockIq3S
impl UnwindSafe for BlockIq3S
Blanket Implementations§
impl<T> AnyBitPattern for Twhere
T: Pod,
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CheckedBitPattern for Twhere
T: AnyBitPattern,
impl<T> CheckedBitPattern for Twhere
T: AnyBitPattern,
Source§type Bits = T
type Bits = T
Self must have the same layout as the specified Bits except for
the possible invalid bit patterns being checked during
is_valid_bit_pattern.Source§fn is_valid_bit_pattern(_bits: &T) -> bool
fn is_valid_bit_pattern(_bits: &T) -> bool
If this function returns true, then it must be valid to reinterpret
bits
as &Self.Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more