pub struct GpuLamb { /* private fields */ }Expand description
GPU LAMB with a real layer-wise trust ratio.
One step is two dispatches of the same pipeline: the first advances the
moments, materialises the Adam-style update direction and reduces
||params||^2 / ||update||^2 per workgroup; the host finishes the
reduction and computes trust = ||params|| / ||update||; the second applies
p -= lr * trust * update. When either norm is zero the ratio degenerates
to 1, matching the reference implementation.
Implementations§
Source§impl GpuLamb
impl GpuLamb
Sourcepub fn new(params: AdamParams) -> Result<Self, GpuOptimError>
pub fn new(params: AdamParams) -> Result<Self, GpuOptimError>
Create the optimizer with the default WebGPU backend.
Sourcepub fn with_config(
params: AdamParams,
config: GpuOptimizerConfig,
) -> Result<Self, GpuOptimError>
pub fn with_config( params: AdamParams, config: GpuOptimizerConfig, ) -> Result<Self, GpuOptimError>
Create the optimizer on an explicit backend.
Sourcepub fn backend(&self) -> GpuBackend
pub fn backend(&self) -> GpuBackend
Backend actually in use.
Sourcepub fn move_to_gpu(&mut self) -> Result<(), GpuOptimError>
pub fn move_to_gpu(&mut self) -> Result<(), GpuOptimError>
Upload the optimizer state to device memory.
Inherent alias for GpuOptimizer::move_to_gpu so callers do not
need a turbofish to pin the unused dimension parameter.
Sourcepub fn move_to_cpu(&mut self) -> Result<(), GpuOptimError>
pub fn move_to_cpu(&mut self) -> Result<(), GpuOptimError>
Download the optimizer state back to host memory.
Inherent alias for GpuOptimizer::move_to_cpu; see
Self::move_to_gpu.
Sourcepub fn to_gpu(&mut self) -> Result<(), GpuOptimError>
👎Deprecated since 0.3.2: renamed to move_to_gpu
pub fn to_gpu(&mut self) -> Result<(), GpuOptimError>
renamed to move_to_gpu
Deprecated alias for Self::move_to_gpu.
Sourcepub fn to_cpu(&mut self) -> Result<(), GpuOptimError>
👎Deprecated since 0.3.2: renamed to move_to_cpu
pub fn to_cpu(&mut self) -> Result<(), GpuOptimError>
renamed to move_to_cpu
Deprecated alias for Self::move_to_cpu.
Sourcepub fn is_gpu_available(&self) -> bool
pub fn is_gpu_available(&self) -> bool
Whether a real device (not the CPU fallback) is backing this optimizer.
Sourcepub fn step_count(&self) -> u64
pub fn step_count(&self) -> u64
Number of updates applied so far.
Trait Implementations§
Source§impl<D: Dimension> GpuOptimizer<f32, D> for GpuLamb
impl<D: Dimension> GpuOptimizer<f32, D> for GpuLamb
Source§fn is_gpu_available(&self) -> bool
fn is_gpu_available(&self) -> bool
Source§fn move_to_gpu(&mut self) -> Result<(), GpuOptimError>
fn move_to_gpu(&mut self) -> Result<(), GpuOptimError>
Source§fn move_to_cpu(&mut self) -> Result<(), GpuOptimError>
fn move_to_cpu(&mut self) -> Result<(), GpuOptimError>
Source§fn step_gpu(
&mut self,
params: &mut Array<f32, D>,
gradients: &Array<f32, D>,
) -> Result<(), GpuOptimError>
fn step_gpu( &mut self, params: &mut Array<f32, D>, gradients: &Array<f32, D>, ) -> Result<(), GpuOptimError>
Source§fn to_gpu(&mut self) -> Result<(), GpuOptimError>
fn to_gpu(&mut self) -> Result<(), GpuOptimError>
renamed to move_to_gpu
Self::move_to_gpu. Read moreSource§fn to_cpu(&mut self) -> Result<(), GpuOptimError>
fn to_cpu(&mut self) -> Result<(), GpuOptimError>
renamed to move_to_cpu
Self::move_to_cpu. Read moreAuto Trait Implementations§
impl !RefUnwindSafe for GpuLamb
impl !UnwindSafe for GpuLamb
impl Freeze for GpuLamb
impl Send for GpuLamb
impl Sync for GpuLamb
impl Unpin for GpuLamb
impl UnsafeUnpin for GpuLamb
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more