Struct MatvecKind 

pub struct MatvecKind {
    pub name: &'static str,
    pub module_name: &'static str,
    pub fn_name: &'static str,
    pub src: &'static str,
}

One quantized weight format the CUDA matvec path can consume.

The __global__ entry point named by Self::fn_name must have the signature every kernel in this directory shares:

void <fn_name>(const unsigned char* weights, const float* x,
               float* out, int rows, int row_bytes,
               int n_blocks_per_row)

one threadblock per output row, 256 threads striding the row’s blocks, a tree reduction into out[row]. launch_matvec supplies exactly that geometry, so a kernel written to a different one returns wrong numbers rather than failing.

Fields

name: &'static str

GGUF quant name – the key ferrox-core looks a kind up by, which is QuantKind::name().

module_name: &'static str

NVRTC module cache key. Must be unique per kind.

fn_name: &'static str

The __global__ entry point inside that module.

src: &'static str

The complete translation unit defining it.

Trait Implementations

impl Clone for MatvecKind

fn clone(&self) -> MatvecKind

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for MatvecKind

impl Debug for MatvecKind

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.