Struct Param

Source
pub struct Param<T: Parameter> {
    pub id: ParamId,
    /* private fields */
}
Expand description

Parameters are the fundamental building blocks of modules where they serve as containers for tensors that can be updated during training, and loaded during inference. If you don’t want to save the tensors with a record and/or don’t want to update it during training, you don’t need this type to wrap your tensor.

§Laziness

The initialization of parameters can be lazy when created using uninitialized, which can be done using an initializer.

This reduces the amount of allocations done when loading a model for inference without having to create a custom initialization function only for inference.

§Example

let device = Device::default();
let config = ModuleConfig::default();
let record = Recorder::new().load("/path/to/module", &device);

// No tensor allocation
let module = config.init(device);
// Will use the tensor allocated for the record if the same device is used.
let module = module.load_record(record);

Fields§

§id: ParamId

The unique ID of this parameter. This is used by eg. optimizers to associate a gradient with a specific parameter.

Implementations§

Source§

impl<T: Parameter> Param<T>

Source

pub fn initialized(id: ParamId, value: T) -> Self

Create a new parameter that is already initialized.

Source

pub fn uninitialized<F>( id: ParamId, init: F, device: T::Device, is_require_grad: bool, ) -> Self
where F: FnOnce(&T::Device, bool) -> T + Send + 'static,

Create a new parameter that is not already initialized.

Source

pub fn val(&self) -> T

Gets the parameter value.

Source

pub fn into_value(self) -> T

Gets the parameter’s value while consuming the parameter.

Source

pub fn consume(self) -> (ParamId, T)

Gets the parameter id and value while consuming the parameter.

Source

pub fn map<F: FnOnce(T) -> T>(self, func: F) -> Self

Execute the given function on the inner value.

Source

pub fn set_require_grad(self, require_grad: bool) -> Self

Override the gradient requirement for the current parameter.

Source§

impl<B: Backend, const D: usize> Param<Tensor<B, D>>

Source

pub fn from_tensor(value: Tensor<B, D>) -> Self

Create a new parameter from a float tensor.

§Warnings

We strongly recommend using Param::uninitialized if you are using this method to initialize parameters inside a module, since the tensor initialization will be lazy, making the loading of weights more performant.

Source

pub fn from_data<T>(data: T, device: &B::Device) -> Self
where T: Into<TensorData>,

Create a new parameter from data.

Trait Implementations§

Source§

impl<const D: usize, B: AutodiffBackend> AutodiffModule<B> for Param<Tensor<B, D>>

Source§

type InnerModule = Param<Tensor<<B as AutodiffBackend>::InnerBackend, D>>

Inner module without auto-differentiation.
Source§

fn valid(&self) -> Self::InnerModule

Get the same module, but on the inner backend without auto-differentiation.
Source§

impl<const D: usize, B: AutodiffBackend> AutodiffModule<B> for Param<Tensor<B, D, Bool>>

Source§

type InnerModule = Param<Tensor<<B as AutodiffBackend>::InnerBackend, D, Bool>>

Inner module without auto-differentiation.
Source§

fn valid(&self) -> Self::InnerModule

Get the same module, but on the inner backend without auto-differentiation.
Source§

impl<const D: usize, B: AutodiffBackend> AutodiffModule<B> for Param<Tensor<B, D, Int>>

Source§

type InnerModule = Param<Tensor<<B as AutodiffBackend>::InnerBackend, D, Int>>

Inner module without auto-differentiation.
Source§

fn valid(&self) -> Self::InnerModule

Get the same module, but on the inner backend without auto-differentiation.
Source§

impl<T: Parameter> Clone for Param<T>

Source§

fn clone(&self) -> Self

Returns a duplicate of the value. Read more
1.0.0 · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl<T: Parameter> Debug for Param<T>

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl<T: Parameter> Deref for Param<T>

Source§

type Target = T

The resulting type after dereferencing.
Source§

fn deref(&self) -> &Self::Target

Dereferences the value.
Source§

impl<T: Parameter> Display for Param<T>

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl<const D: usize, B: Backend> Module<B> for Param<Tensor<B, D>>

Source§

type Record = Param<Tensor<B, D>>

Type to save and load the module.
Source§

fn visit<V: ModuleVisitor<B>>(&self, visitor: &mut V)

Visit each tensor parameter in the module with a visitor.
Source§

fn map<M: ModuleMapper<B>>(self, mapper: &mut M) -> Self

Map each tensor parameter in the module with a mapper.
Source§

fn into_record(self) -> Self::Record

Convert the module into a record containing the state.
Source§

fn load_record(self, record: Self::Record) -> Self

Load the module state from a record.
Source§

fn to_device(self, device: &Device<B>) -> Self

Move the module and all of its sub-modules to the given device. Read more
Source§

fn fork(self, device: &Device<B>) -> Self

Fork the module and all of its sub-modules to the given device. Read more
Source§

fn collect_devices(&self, devices: Vec<Device<B>>) -> Vec<Device<B>>

Return all the devices found in the underneath module tree added to the given vector without duplicates.
Source§

fn devices(&self) -> Devices<B>

Return all the devices found in the underneath module tree without duplicates.
Source§

fn no_grad(self) -> Self

Each tensor in the module tree will not require grad. Read more
Source§

fn num_params(&self) -> usize

Get the number of parameters the module has, including all of its sub-modules.
Source§

fn save_file<FR, PB>( self, file_path: PB, recorder: &FR, ) -> Result<(), RecorderError>
where FR: FileRecorder<B>, PB: Into<PathBuf>,

Available on crate feature std only.
Save the module to a file using the provided file recorder. Read more
Source§

fn load_file<FR, PB>( self, file_path: PB, recorder: &FR, device: &B::Device, ) -> Result<Self, RecorderError>
where FR: FileRecorder<B>, PB: Into<PathBuf>,

Available on crate feature std only.
Load the module from a file using the provided file recorder. Read more
Source§

fn quantize_weights(self, quantizer: &mut Quantizer) -> Self

Quantize the weights of the module.
Source§

impl<const D: usize, B: Backend> Module<B> for Param<Tensor<B, D, Bool>>

Source§

type Record = Param<Tensor<B, D, Bool>>

Type to save and load the module.
Source§

fn visit<V: ModuleVisitor<B>>(&self, visitor: &mut V)

Visit each tensor parameter in the module with a visitor.
Source§

fn map<M: ModuleMapper<B>>(self, mapper: &mut M) -> Self

Map each tensor parameter in the module with a mapper.
Source§

fn into_record(self) -> Self::Record

Convert the module into a record containing the state.
Source§

fn load_record(self, record: Self::Record) -> Self

Load the module state from a record.
Source§

fn to_device(self, device: &Device<B>) -> Self

Move the module and all of its sub-modules to the given device. Read more
Source§

fn fork(self, device: &Device<B>) -> Self

Fork the module and all of its sub-modules to the given device. Read more
Source§

fn collect_devices(&self, devices: Vec<Device<B>>) -> Vec<Device<B>>

Return all the devices found in the underneath module tree added to the given vector without duplicates.
Source§

fn devices(&self) -> Devices<B>

Return all the devices found in the underneath module tree without duplicates.
Source§

fn no_grad(self) -> Self

Each tensor in the module tree will not require grad. Read more
Source§

fn num_params(&self) -> usize

Get the number of parameters the module has, including all of its sub-modules.
Source§

fn save_file<FR, PB>( self, file_path: PB, recorder: &FR, ) -> Result<(), RecorderError>
where FR: FileRecorder<B>, PB: Into<PathBuf>,

Available on crate feature std only.
Save the module to a file using the provided file recorder. Read more
Source§

fn load_file<FR, PB>( self, file_path: PB, recorder: &FR, device: &B::Device, ) -> Result<Self, RecorderError>
where FR: FileRecorder<B>, PB: Into<PathBuf>,

Available on crate feature std only.
Load the module from a file using the provided file recorder. Read more
Source§

fn quantize_weights(self, quantizer: &mut Quantizer) -> Self

Quantize the weights of the module.
Source§

impl<const D: usize, B: Backend> Module<B> for Param<Tensor<B, D, Int>>

Source§

type Record = Param<Tensor<B, D, Int>>

Type to save and load the module.
Source§

fn visit<V: ModuleVisitor<B>>(&self, visitor: &mut V)

Visit each tensor parameter in the module with a visitor.
Source§

fn map<M: ModuleMapper<B>>(self, mapper: &mut M) -> Self

Map each tensor parameter in the module with a mapper.
Source§

fn into_record(self) -> Self::Record

Convert the module into a record containing the state.
Source§

fn load_record(self, record: Self::Record) -> Self

Load the module state from a record.
Source§

fn to_device(self, device: &Device<B>) -> Self

Move the module and all of its sub-modules to the given device. Read more
Source§

fn fork(self, device: &Device<B>) -> Self

Fork the module and all of its sub-modules to the given device. Read more
Source§

fn collect_devices(&self, devices: Vec<Device<B>>) -> Vec<Device<B>>

Return all the devices found in the underneath module tree added to the given vector without duplicates.
Source§

fn devices(&self) -> Devices<B>

Return all the devices found in the underneath module tree without duplicates.
Source§

fn no_grad(self) -> Self

Each tensor in the module tree will not require grad. Read more
Source§

fn num_params(&self) -> usize

Get the number of parameters the module has, including all of its sub-modules.
Source§

fn save_file<FR, PB>( self, file_path: PB, recorder: &FR, ) -> Result<(), RecorderError>
where FR: FileRecorder<B>, PB: Into<PathBuf>,

Available on crate feature std only.
Save the module to a file using the provided file recorder. Read more
Source§

fn load_file<FR, PB>( self, file_path: PB, recorder: &FR, device: &B::Device, ) -> Result<Self, RecorderError>
where FR: FileRecorder<B>, PB: Into<PathBuf>,

Available on crate feature std only.
Load the module from a file using the provided file recorder. Read more
Source§

fn quantize_weights(self, quantizer: &mut Quantizer) -> Self

Quantize the weights of the module.
Source§

impl<const D: usize, B: Backend> ModuleDisplay for Param<Tensor<B, D>>

Source§

fn format(&self, passed_settings: DisplaySettings) -> String

Formats the module with provided display settings. Read more
Source§

fn custom_settings(&self) -> Option<DisplaySettings>

Custom display settings for the module. Read more
Source§

fn custom_content(&self, _content: Content) -> Option<Content>

Custom attributes for the module. Read more
Source§

impl<const D: usize, B: Backend> ModuleDisplay for Param<Tensor<B, D, Bool>>

Source§

fn format(&self, passed_settings: DisplaySettings) -> String

Formats the module with provided display settings. Read more
Source§

fn custom_settings(&self) -> Option<DisplaySettings>

Custom display settings for the module. Read more
Source§

fn custom_content(&self, _content: Content) -> Option<Content>

Custom attributes for the module. Read more
Source§

impl<const D: usize, B: Backend> ModuleDisplay for Param<Tensor<B, D, Int>>

Source§

fn format(&self, passed_settings: DisplaySettings) -> String

Formats the module with provided display settings. Read more
Source§

fn custom_settings(&self) -> Option<DisplaySettings>

Custom display settings for the module. Read more
Source§

fn custom_content(&self, _content: Content) -> Option<Content>

Custom attributes for the module. Read more
Source§

impl<const D: usize, B: Backend> ModuleDisplayDefault for Param<Tensor<B, D>>

Source§

fn content(&self, content: Content) -> Option<Content>

Attributes of the module used for display purposes. Read more
Source§

fn num_params(&self) -> usize

Gets the number of the parameters of the module.
Source§

impl<const D: usize, B: Backend> ModuleDisplayDefault for Param<Tensor<B, D, Bool>>

Source§

fn content(&self, content: Content) -> Option<Content>

Attributes of the module used for display purposes. Read more
Source§

fn num_params(&self) -> usize

Gets the number of the parameters of the module.
Source§

impl<const D: usize, B: Backend> ModuleDisplayDefault for Param<Tensor<B, D, Int>>

Source§

fn content(&self, content: Content) -> Option<Content>

Attributes of the module used for display purposes. Read more
Source§

fn num_params(&self) -> usize

Gets the number of the parameters of the module.
Source§

impl<B, const D: usize> Record<B> for Param<Tensor<B, D>>
where B: Backend,

Source§

type Item<S: PrecisionSettings> = ParamSerde<FloatTensorSerde<S>>

Type of the item that can be serialized and deserialized.
Source§

fn into_item<S: PrecisionSettings>(self) -> Self::Item<S>

Convert the current record into the corresponding item that follows the given settings.
Source§

fn from_item<S: PrecisionSettings>( item: Self::Item<S>, device: &B::Device, ) -> Self

Convert the given item into a record.
Source§

impl<B, const D: usize> Record<B> for Param<Tensor<B, D, Bool>>
where B: Backend,

Source§

type Item<S: PrecisionSettings> = ParamSerde<BoolTensorSerde>

Type of the item that can be serialized and deserialized.
Source§

fn into_item<S: PrecisionSettings>(self) -> Self::Item<S>

Convert the current record into the corresponding item that follows the given settings.
Source§

fn from_item<S: PrecisionSettings>( item: Self::Item<S>, device: &B::Device, ) -> Self

Convert the given item into a record.
Source§

impl<B, const D: usize> Record<B> for Param<Tensor<B, D, Int>>
where B: Backend,

Source§

type Item<S: PrecisionSettings> = ParamSerde<IntTensorSerde<S>>

Type of the item that can be serialized and deserialized.
Source§

fn into_item<S: PrecisionSettings>(self) -> Self::Item<S>

Convert the current record into the corresponding item that follows the given settings.
Source§

fn from_item<S: PrecisionSettings>( item: Self::Item<S>, device: &B::Device, ) -> Self

Convert the given item into a record.

Auto Trait Implementations§

§

impl<T> !Freeze for Param<T>

§

impl<T> !RefUnwindSafe for Param<T>

§

impl<T> Send for Param<T>
where <T as Parameter>::Device: Send,

§

impl<T> !Sync for Param<T>

§

impl<T> Unpin for Param<T>
where T: Unpin, <T as Parameter>::Device: Unpin,

§

impl<T> UnwindSafe for Param<T>
where T: UnwindSafe,

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> IntoEither for T

Source§

fn into_either(self, into_left: bool) -> Either<Self, Self>

Converts self into a Left variant of Either<Self, Self> if into_left is true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
where F: FnOnce(&Self) -> bool,

Converts self into a Left variant of Either<Self, Self> if into_left(&self) returns true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

impl<T> Pointable for T

Source§

const ALIGN: usize

The alignment of pointer.
Source§

type Init = T

The type for initializers.
Source§

unsafe fn init(init: <T as Pointable>::Init) -> usize

Initializes a with the given initializer. Read more
Source§

unsafe fn deref<'a>(ptr: usize) -> &'a T

Dereferences the given pointer. Read more
Source§

unsafe fn deref_mut<'a>(ptr: usize) -> &'a mut T

Mutably dereferences the given pointer. Read more
Source§

unsafe fn drop(ptr: usize)

Drops the object pointed to by the given pointer. Read more
Source§

impl<P, T> Receiver for P
where P: Deref<Target = T> + ?Sized, T: ?Sized,

Source§

type Target = T

🔬This is a nightly-only experimental API. (arbitrary_self_types)
The target type on which the method may be called.
Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T> ToString for T
where T: Display + ?Sized,

Source§

fn to_string(&self) -> String

Converts the given value to a String. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

Source§

fn vzip(self) -> V

Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

impl<T> ErasedDestructor for T
where T: 'static,

Source§

impl<T> MaybeSendSync for T