Skip to main content

StaticWeightTransformPlan

Enum StaticWeightTransformPlan 

Source
pub enum StaticWeightTransformPlan {
    BlockFp8ToMarlinFp8Group128 {
        source_values_id: WeightId,
        source_scales_id: WeightId,
        packed_values_id: WeightId,
        scales_id: WeightId,
        logical_dimensions: Vec<u64>,
        matrices_per_output: u32,
    },
    GptOssMxfp4ToMarlin {
        source_blocks_id: WeightId,
        source_scales_id: WeightId,
        packed_values_id: WeightId,
        scales_id: WeightId,
        logical_dimensions: Vec<u64>,
        execution_dimensions: Vec<u64>,
    },
}
Expand description

One required cold-path device transform from source checkpoint components into final execution-weight components.

The first supported producer preserves official E4M3 bytes, converts the BF16 inverse-scale grid into Marlin’s grouped F16 scale ABI, and repacks one logical matrix at a time. matrices_per_output == 2 represents the routed gate/up fusion [E, 2, N, K] -> [E, 2N, K]; all other projections use one.

Variants§

§

BlockFp8ToMarlinFp8Group128

Fields

§source_values_id: WeightId
§source_scales_id: WeightId
§packed_values_id: WeightId
§scales_id: WeightId
§logical_dimensions: Vec<u64>
§matrices_per_output: u32
§

GptOssMxfp4ToMarlin

Fields

§source_blocks_id: WeightId
§source_scales_id: WeightId
§packed_values_id: WeightId
§scales_id: WeightId
§logical_dimensions: Vec<u64>
§execution_dimensions: Vec<u64>

Implementations§

Source§

impl StaticWeightTransformPlan

Source

pub fn source_component_ids(&self) -> [&WeightId; 2]

Source

pub fn execution_component_ids(&self) -> [&WeightId; 2]

Source

pub fn logical_dimensions(&self) -> &[u64]

Source

pub fn execution_dimensions(&self) -> &[u64]

Matrix dimensions consumed by the native execution kernel after any explicitly typed cold-path padding. Block-FP8 transforms are exact; GPT-OSS MXFP4 may zero-extend only K to a supported Marlin tile.

Source

pub const fn matrices_per_output(&self) -> u32

Source

pub fn scratch_bytes(&self) -> Result<u64, VNextError>

Device scratch is shared across transforms and sized for the largest single fused output matrix, never for the model or expert count.

Trait Implementations§

Source§

impl Clone for StaticWeightTransformPlan

Source§

fn clone(&self) -> StaticWeightTransformPlan

Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Debug for StaticWeightTransformPlan

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl<'de> Deserialize<'de> for StaticWeightTransformPlan

Source§

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>
where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer. Read more
Source§

impl Eq for StaticWeightTransformPlan

Source§

impl Ord for StaticWeightTransformPlan

Source§

fn cmp(&self, other: &StaticWeightTransformPlan) -> Ordering

This method returns an Ordering between self and other. Read more
1.21.0 (const: unstable) · Source§

fn max(self, other: Self) -> Self
where Self: Sized,

Compares and returns the maximum of two values. Read more
1.21.0 (const: unstable) · Source§

fn min(self, other: Self) -> Self
where Self: Sized,

Compares and returns the minimum of two values. Read more
1.50.0 (const: unstable) · Source§

fn clamp(self, min: Self, max: Self) -> Self
where Self: Sized,

Restrict a value to a certain interval. Read more
Source§

fn clamp_to<R>(self, range: R) -> Self
where Self: Sized, R: ClampBounds<Self>,

🔬This is a nightly-only experimental API. (clamp_to)
Restrict a value to a certain range. Read more
Source§

impl PartialEq for StaticWeightTransformPlan

Source§

fn eq(&self, other: &StaticWeightTransformPlan) -> bool

Equality operator ==. Read more
1.0.0 (const: unstable) · Source§

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=. Read more
Source§

impl PartialOrd for StaticWeightTransformPlan

Source§

fn partial_cmp(&self, other: &StaticWeightTransformPlan) -> Option<Ordering>

This method returns an ordering between self and other values if one exists. Read more
1.0.0 (const: unstable) · Source§

fn lt(&self, other: &Rhs) -> bool

Tests less than (for self and other) and is used by the < operator. Read more
1.0.0 (const: unstable) · Source§

fn le(&self, other: &Rhs) -> bool

Tests less than or equal to (for self and other) and is used by the <= operator. Read more
1.0.0 (const: unstable) · Source§

fn gt(&self, other: &Rhs) -> bool

Tests greater than (for self and other) and is used by the > operator. Read more
1.0.0 (const: unstable) · Source§

fn ge(&self, other: &Rhs) -> bool

Tests greater than or equal to (for self and other) and is used by the >= operator. Read more
Source§

impl Serialize for StaticWeightTransformPlan

Source§

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>
where __S: Serializer,

Serialize this value into the given Serde serializer. Read more
Source§

impl StructuralPartialEq for StaticWeightTransformPlan

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> DeserializeOwned for T
where T: for<'de> Deserialize<'de>,

Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = !

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

Source§

fn vzip(self) -> V