Enum TokenizedMultimodalSegment 

pub enum TokenizedMultimodalSegment {
    TokenIds(Vec<u32>),
    Media(Media),
}

One ordered segment after facade tokenization and before backend preprocessing.

Variants

TokenIds(Vec<u32>)

Tokenizer vocabulary IDs.

Media(Media)

Decoded media.

Trait Implementations

impl Clone for TokenizedMultimodalSegment

fn clone(&self) -> TokenizedMultimodalSegment

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TokenizedMultimodalSegment

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for TokenizedMultimodalSegment

fn eq(&self, other: &TokenizedMultimodalSegment) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for TokenizedMultimodalSegment