pub struct Embedding {
pub weight: Tensor,
}Expand description
Token embedding table.
Fields§
§weight: TensorEmbedding table [vocab, hidden].
Implementations§
Source§impl Embedding
impl Embedding
Sourcepub fn forward(
&self,
ctx: &WgpuContext,
_engine: &ComputeEngine,
input_ids: &[u32],
) -> Tensor
pub fn forward( &self, ctx: &WgpuContext, _engine: &ComputeEngine, input_ids: &[u32], ) -> Tensor
Looks up input_ids and returns [1, seq, hidden]. The lookup runs
on the CPU (the table is read back from the GPU).
Auto Trait Implementations§
impl !RefUnwindSafe for Embedding
impl !Send for Embedding
impl !Sync for Embedding
impl !UnwindSafe for Embedding
impl Freeze for Embedding
impl Unpin for Embedding
impl UnsafeUnpin for Embedding
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more