Enum CausalBatchLayout 

pub enum CausalBatchLayout {
    Packed,
    Padded {
        pad_token_id: i64,
        padding: CausalPadding,
    },
}

Available on crate feature std only.

Device batch layout explicitly selected by the caller’s model contract.

Variants

Packed

Concatenate documents, retaining cumulative boundaries and reset positions.

Padded

Rectangular token rows with an explicit tokenizer padding ID/direction.

Fields

pad_token_id: i64

Actual tokenizer’s pad ID; never inferred from EOS or vocabulary size.

padding: CausalPadding

Which side of each real document receives batch padding.

Trait Implementations

impl Clone for CausalBatchLayout

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for CausalBatchLayout

impl Debug for CausalBatchLayout

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for CausalBatchLayout

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Eq for CausalBatchLayout

impl PartialEq for CausalBatchLayout

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for CausalBatchLayout

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for CausalBatchLayout