Struct PackedCausalBatch 

pub struct PackedCausalBatch<B: Backend> {
    pub input_ids: Tensor<B, 1, Int>,
    pub labels: Tensor<B, 1, Int>,
    pub attention_mask: Tensor<B, 1, Bool>,
    pub position_ids: Tensor<B, 1, Int>,
    pub boundaries: Vec<usize>,
    pub maximum_sequence_length: usize,
    pub supervised_tokens: usize,
    pub ignore_index: i64,
    pub target_alignment: CausalTargetAlignment,
}

Available on crate feature std only.

Flat actual documents, ready for an explicit packed-attention model.

Fields

input_ids: Tensor<B, 1, Int>

Actual flat token IDs, without separator or filler tokens.

labels: Tensor<B, 1, Int>

Supervised labels with ignored document starts for next-token training.

attention_mask: Tensor<B, 1, Bool>

True for every real token; no physical padding in this representation.

position_ids: Tensor<B, 1, Int>

Per-document positions reset to zero.

boundaries: Vec<usize>

Cumulative physical token boundaries, beginning with zero.

maximum_sequence_length: usize

Maximum actual document length.

supervised_tokens: usize

Actual nonignored supervised targets under the selected alignment.

ignore_index: i64

Actual label sentinel used during collation.

target_alignment: CausalTargetAlignment

Target alignment recorded for the downstream loss contract.

Implementations

impl<B: Backend> PackedCausalBatch<B>

pub fn examples(&self) -> usize

Actual document count, not token count or a padded batch dimension.

pub fn to_device(self, device: &B::Device) -> Self

Move the actual tensors to the caller-selected backend device.

impl<B: Backend> PackedCausalBatch<B>

pub fn token_inputs(&self) -> PackedTokenBatch<B>

Label-free flat input view with the exact original document boundaries.

Trait Implementations

impl<B: Clone + Backend> Clone for PackedCausalBatch<B>

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<B: Debug + Backend> Debug for PackedCausalBatch<B>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.