Enum OrdinaryWeightResidency 

#[non_exhaustive]
pub enum OrdinaryWeightResidency {
    FullyResident,
    LayerwiseHost(LayerwiseLoadOptions),
    DenseDiskStream(DenseDiskStreamLoadOptions),
}

Placement of ordinary parameters beside independently addressable banks.

Variants (Non-exhaustive)

Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.

FullyResident

Keep every ordinary parameter resident on the execution device.

LayerwiseHost(LayerwiseLoadOptions)

Eagerly materialize ordinary units on host behind a device window.

DenseDiskStream(DenseDiskStreamLoadOptions)

Leave ordinary units cold on disk behind finite tier caches.

Implementations

impl OrdinaryWeightResidency

pub const fn layers(self) -> LayerWeightResidency

Returns the corresponding generalized layer policy.

Trait Implementations

impl Clone for OrdinaryWeightResidency

fn clone(&self) -> OrdinaryWeightResidency

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for OrdinaryWeightResidency

impl Debug for OrdinaryWeightResidency

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for OrdinaryWeightResidency

impl From<OrdinaryWeightResidency> for LayerWeightResidency

fn from(value: OrdinaryWeightResidency) -> Self

Converts to this type from the input type.

impl PartialEq for OrdinaryWeightResidency

fn eq(&self, other: &OrdinaryWeightResidency) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for OrdinaryWeightResidency