pub enum LayeredPartitionOutput<T, A = NoAuxiliaryBoundary> {
Final {
output: T,
retained: Option<T>,
},
Boundary {
hidden: T,
auxiliary: A,
},
}Expand description
Architecture-owned result of completing one layered partition.
The runtime and concrete transports only distinguish a final output from a transport boundary. Families retain ownership of auxiliary boundary values and of any hidden activation required by an embedded predictor.
Variants§
Final
Complete architecture output produced by the output owner.
Fields
§
output: TProjected architecture output, normally vocabulary logits.
Boundary
Values transported to the next pipeline owner.
Auto Trait Implementations§
impl<T, A> Freeze for LayeredPartitionOutput<T, A>
impl<T, A> RefUnwindSafe for LayeredPartitionOutput<T, A>
impl<T, A> Send for LayeredPartitionOutput<T, A>
impl<T, A> Sync for LayeredPartitionOutput<T, A>
impl<T, A> Unpin for LayeredPartitionOutput<T, A>
impl<T, A> UnsafeUnpin for LayeredPartitionOutput<T, A>
impl<T, A> UnwindSafe for LayeredPartitionOutput<T, A>
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more