pub struct TransformerDecoderAutoregressiveCache<B: Backend> { /* private fields */ }Expand description
Autoregressive cache for the Transformer Decoder layer.
To be used during inference when decoding tokens.
Auto Trait Implementations§
impl<B> RefUnwindSafe for TransformerDecoderAutoregressiveCache<B>where
<B as Backend>::FloatTensorPrimitive<3>: RefUnwindSafe,
<B as Backend>::FloatTensorPrimitive<4>: RefUnwindSafe,
impl<B> Send for TransformerDecoderAutoregressiveCache<B>
impl<B> Sync for TransformerDecoderAutoregressiveCache<B>
impl<B> Unpin for TransformerDecoderAutoregressiveCache<B>where
<B as Backend>::FloatTensorPrimitive<3>: Unpin,
<B as Backend>::FloatTensorPrimitive<4>: Unpin,
impl<B> UnwindSafe for TransformerDecoderAutoregressiveCache<B>where
<B as Backend>::FloatTensorPrimitive<3>: UnwindSafe,
<B as Backend>::FloatTensorPrimitive<4>: UnwindSafe,
Blanket Implementations§
source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more