pub struct TransformerDecoder { /* private fields */ }Expand description
Decoder using the transformer architecture.
Trait Implementations§
Source§impl Decoder for TransformerDecoder
impl Decoder for TransformerDecoder
Source§type Cache = KeyValueCache
type Cache = KeyValueCache
Cache type for the decoder.
Source§fn forward_t(
&self,
piece_ids: &Tensor,
attention_mask: &AttentionMask,
cache: &mut Self::Cache,
positions: Option<&Tensor>,
train: bool,
) -> Result<DecoderOutput, BoxedError>
fn forward_t( &self, piece_ids: &Tensor, attention_mask: &AttentionMask, cache: &mut Self::Cache, positions: Option<&Tensor>, train: bool, ) -> Result<DecoderOutput, BoxedError>
Decode an input sequence. Read more
Auto Trait Implementations§
impl Freeze for TransformerDecoder
impl !RefUnwindSafe for TransformerDecoder
impl !Send for TransformerDecoder
impl !Sync for TransformerDecoder
impl Unpin for TransformerDecoder
impl !UnwindSafe for TransformerDecoder
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more