pub enum BlockInput<'a> {
Tokens(&'a [u32]),
Hidden(&'a [f32]),
}Expand description
Input handed to a BlockRunner.
Variants§
Tokens(&'a [u32])
Token ids — only the First/Single block receives these (it embeds).
Hidden(&'a [f32])
Hidden states [batch * seq * hidden] from the previous block.
Auto Trait Implementations§
impl<'a> Freeze for BlockInput<'a>
impl<'a> RefUnwindSafe for BlockInput<'a>
impl<'a> Send for BlockInput<'a>
impl<'a> Sync for BlockInput<'a>
impl<'a> Unpin for BlockInput<'a>
impl<'a> UnsafeUnpin for BlockInput<'a>
impl<'a> UnwindSafe for BlockInput<'a>
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more