Struct Seq2SeqBatcher 

pub struct Seq2SeqBatcher {
    pub layout: Seq2SeqBatchLayout,
    pub ignore_index: i64,
    pub maximum_encoder_length: Option<usize>,
    pub maximum_decoder_length: Option<usize>,
}

Available on crate feature std only.

Native paired collation without model-specific target construction or truncation.

Fields

layout: Seq2SeqBatchLayout

Actual source/decoder tensor layout.

ignore_index: i64

Explicit decoder target sentinel; independent of either attention mask.

maximum_encoder_length: Option<usize>

Optional source limit; excess documents are rejected, never truncated.

maximum_decoder_length: Option<usize>

Optional decoder limit, independently enforced before uploading tensors.

Implementations

impl Seq2SeqBatcher

pub fn validate( &self, samples: &[Seq2SeqExample], ) -> Result<(), Seq2SeqDataError>

Validate both actual sequence axes and all explicit policies before tensor upload.

pub fn collate<B: Backend>( &self, samples: Vec<Seq2SeqExample>, device: &B::Device, ) -> Result<Seq2SeqBatch<B>, Seq2SeqDataError>

Collate exact supplied pairs; reuse native aligned decoder label/count handling. No implicit teacher-forcing shift, BOS/EOS insertion, truncation or prompt masking.

Trait Implementations

impl<B: Backend> Batcher<B, Seq2SeqExample, Result<Seq2SeqBatch<B>, Seq2SeqDataError>> for Seq2SeqBatcher

Available on crate feature dataset only.

fn batch( &self, items: Vec<Seq2SeqExample>, device: &B::Device, ) -> Result<Seq2SeqBatch<B>, Seq2SeqDataError>

Batches the given items on the specified device.

impl Clone for Seq2SeqBatcher

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Seq2SeqBatcher

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for Seq2SeqBatcher

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Eq for Seq2SeqBatcher

impl PartialEq for Seq2SeqBatcher

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for Seq2SeqBatcher

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for Seq2SeqBatcher