Skip to main content

BlrCore

Struct BlrCore 

Source
pub struct BlrCore {
    pub rows: usize,
    pub cols: usize,
    pub paths: usize,
    pub rank: usize,
    pub h: Vec<Vec<f32>>,
    pub g: Vec<Vec<f32>>,
    pub l: Vec<Vec<f32>>,
    pub u_off: Vec<usize>,
    pub v_off: Vec<usize>,
}
Expand description

Parsed header + f32 scales of a blr payload; kernels take the bytes.

Fields§

§rows: usize§cols: usize§paths: usize§rank: usize§h: Vec<Vec<f32>>

Per path: h (rows), g (cols), ℓ (rank), f32.

§g: Vec<Vec<f32>>§l: Vec<Vec<f32>>§u_off: Vec<usize>

Per path: byte offsets of U (rows × r/8) and V (r × cols/8) in the payload.

§v_off: Vec<usize>

Implementations§

Source§

impl BlrCore

Source

pub fn parse(shape: &[usize], bytes: &[u8]) -> Result<Self, String>

Source

pub fn planes<'a>(&self, b: &'a [u8], p: usize) -> (&'a [u8], &'a [u8])

Sign bits of path p: (U, V) byte slices.

Source

pub fn matvec( &self, bytes: &[u8], x: &[f32], out: &mut [f32], pool: Option<&Pool>, )

Single-vector product out[..rows] = W x.

Source

pub fn matmat( &self, bytes: &[u8], xs: &[f32], b: usize, out: &mut [f32], pool: Option<&Pool>, )

Batched product: out[b·rows] = xs[b·cols] · Wᵀ.

Source

pub fn row_f32(&self, bytes: &[u8], i: usize, dst: &mut [f32])

One row of W (embedding-style lookup; rare path).

Source

pub fn add_col_scaled(&self, bytes: &[u8], c: usize, w: f32, out: &mut [f32])

One column of W: out[i] += w · W[i, c].

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self> ⓘ

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self> ⓘ

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = !

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, !>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self> ⓘ
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self> ⓘ

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more