Struct PreparedBatch 

pub struct PreparedBatch {
    pub input_ids: Tensor,
    pub attention_mask: Tensor,
    pub token_type_ids: Tensor,
    pub batch_size: usize,
    pub original_lengths: Vec<usize>,
}

Prepared batch of tokenized inputs ready for inference.

Fields

input_ids: Tensor

Token IDs tensor [batch_size, seq_len]

attention_mask: Tensor

Attention mask tensor [batch_size, seq_len]

token_type_ids: Tensor

Token type IDs tensor [batch_size, seq_len]

batch_size: usize

Number of items in this batch

original_lengths: Vec<usize>

Original text lengths (for debugging)

Trait Implementations

impl Debug for PreparedBatch

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.