Enum CausalBatch 

pub enum CausalBatch<B: Backend> {
    Packed(PackedCausalBatch<B>),
    Padded(PaddedCausalBatch<B>),
}

Available on crate feature std only.

A device batch carrying its actual geometry, not an inferred model family.

Variants

Packed(PackedCausalBatch<B>)

Flat documents for a boundary-aware packed model.

Padded(PaddedCausalBatch<B>)

Masked rectangular rows for a padding-aware model.

Implementations

impl<B: Backend> CausalBatch<B>

pub fn supervised_tokens(&self) -> usize

Actual supervised targets used for weighted microbatch accumulation.

pub fn examples(&self) -> usize

Actual encoded example count for committing the sample cursor.

pub fn to_device(self, device: &B::Device) -> Self

Move a packed or rectangular batch without altering its layout.

Trait Implementations

impl<B: Clone + Backend> Clone for CausalBatch<B>

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<B: Debug + Backend> Debug for CausalBatch<B>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.