pub struct DequantizePerTokenBackwardPlan<TIn: Element, TOut: IntElement> { /* private fields */ }Expand description
dequantize_per_token backward plan.
Straight-through linear:
dq_FP[n, d] = scale[n] * dy[n, d]. Int input is non-differentiable;
FP gradient flows through.
When to use: backward for
DequantizePerTokenPlan.
Dtypes: gradients in {f32, f64, f16, bf16}.
Shape limits: rank-2 [N, D].
Workspace: none.
Precision guarantee: deterministic, bit-stable.
Implementations§
Source§impl<TIn: Element, TOut: IntElement> DequantizePerTokenBackwardPlan<TIn, TOut>
impl<TIn: Element, TOut: IntElement> DequantizePerTokenBackwardPlan<TIn, TOut>
Sourcepub fn select(
_stream: &Stream,
desc: &DequantizePerTokenBackwardDescriptor,
_pref: PlanPreference,
) -> Result<Self>
pub fn select( _stream: &Stream, desc: &DequantizePerTokenBackwardDescriptor, _pref: PlanPreference, ) -> Result<Self>
Pick a kernel for desc.
Sourcepub fn can_implement(
&self,
args: &DequantizePerTokenBackwardArgs<'_, TIn, TOut>,
) -> Result<()>
pub fn can_implement( &self, args: &DequantizePerTokenBackwardArgs<'_, TIn, TOut>, ) -> Result<()>
Validate args.
Sourcepub fn workspace_size(&self) -> usize
pub fn workspace_size(&self) -> usize
Workspace bytes — none.
Sourcepub fn precision_guarantee(&self) -> PrecisionGuarantee
pub fn precision_guarantee(&self) -> PrecisionGuarantee
Numerical guarantees.
Auto Trait Implementations§
impl<TIn, TOut> Freeze for DequantizePerTokenBackwardPlan<TIn, TOut>
impl<TIn, TOut> RefUnwindSafe for DequantizePerTokenBackwardPlan<TIn, TOut>where
TIn: RefUnwindSafe,
TOut: RefUnwindSafe,
impl<TIn, TOut> Send for DequantizePerTokenBackwardPlan<TIn, TOut>
impl<TIn, TOut> Sync for DequantizePerTokenBackwardPlan<TIn, TOut>
impl<TIn, TOut> Unpin for DequantizePerTokenBackwardPlan<TIn, TOut>
impl<TIn, TOut> UnsafeUnpin for DequantizePerTokenBackwardPlan<TIn, TOut>
impl<TIn, TOut> UnwindSafe for DequantizePerTokenBackwardPlan<TIn, TOut>where
TIn: UnwindSafe,
TOut: UnwindSafe,
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more