Available on crate feature
std only.Expand description
Explicit-label causal-LM examples and packed/padded device collation. Causal data collation independent of architecture and tokenizer selection.
Structs§
- Causal
Batcher - Explicit supervision/layout policy shared by every call of a data batcher.
- Causal
Data Error - Invalid actual input/label geometry or explicit batch configuration.
- Causal
Data Error Item - Causal
Example - One already-encoded document with caller-declared supervision.
- Packed
Causal Batch - Flat actual documents, ready for an explicit packed-attention model.
- Padded
Causal Batch - Rectangular actual documents with explicitly masked batch-padding cells.
Enums§
- Causal
Batch - A device batch carrying its actual geometry, not an inferred model family.
- Causal
Batch Layout - Device batch layout explicitly selected by the caller’s model contract.
- Causal
Padding - Direction of rectangular batch padding, not a truncation policy.
- Causal
Target Alignment - Alignment used by the downstream causal loss.