pub struct FlatTokenDecoder { /* private fields */ }Expand description
Experimental token decoding with a one-dimensional approach, working directly on a flat representation of
the model output, with one padding by dimension to access appropriate value. Not very readable, but might
be interresting from a performance standpoint. To be benchmarked, and checked for accurracy according to
the original implementation. In the meantime, prefer the token.rs which performs the same operation in
a much more readable way, basing on the four-dimensional output tensor.
Auto Trait Implementations§
impl Freeze for FlatTokenDecoder
impl RefUnwindSafe for FlatTokenDecoder
impl Send for FlatTokenDecoder
impl Sync for FlatTokenDecoder
impl Unpin for FlatTokenDecoder
impl UnwindSafe for FlatTokenDecoder
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more