Enum QuantF16Kernel 

pub enum QuantF16Kernel {
    F16c,
    Sse,
    Scalar,
}

f16 scoring kernel resolved once per batch (see DenseF32Kernel).

Variants

F16c

Sse

SSE4.1 fused kernel; the dot-only form has no SSE variant and falls back to scalar, exactly as the previous per-call dispatch did.

Scalar

Implementations

impl QuantF16Kernel

pub fn resolve() -> Self

pub fn fused_dot_norm( self, query_f16: &[u16], vec_f16: &[u16], dim: usize, ) -> (f32, f32)

pub fn dot(self, query_f16: &[u16], vec_f16: &[u16], dim: usize) -> f32

Trait Implementations

impl Clone for QuantF16Kernel

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for QuantF16Kernel

impl Debug for QuantF16Kernel

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for QuantF16Kernel

impl PartialEq for QuantF16Kernel

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for QuantF16Kernel