Enum EncoderInput 

pub enum EncoderInput<'a> {
    Item(&'a str),
    Pair((&'a str, &'a str)),
}

Input sequences for Tokenizer::encode.

Variants

Item(&'a str)

Input with a single sequence.

Pair((&'a str, &'a str))

Input with a pair of sequences. Used in tasks such as extractive question answering, where the sequence is (query, context).

Trait Implementations

impl<'a> Clone for EncoderInput<'a>

fn clone(&self) -> EncoderInput<'a>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<'a> Debug for EncoderInput<'a>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'a> From<&'a String> for EncoderInput<'a>

fn from(val: &'a String) -> EncoderInput<'a>

Converts to this type from the input type.

impl<'a> From<&'a str> for EncoderInput<'a>

Construct a tokenizer input with a single sequence.

fn from(val: &'a str) -> EncoderInput<'a>

Converts to this type from the input type.

impl<'a> From<(&'a str, &'a str)> for EncoderInput<'a>

Construct a tokenizer input with a pair of sequences.

fn from(val: (&'a str, &'a str)) -> EncoderInput<'a>

Converts to this type from the input type.

impl<'a> PartialEq for EncoderInput<'a>

fn eq(&self, other: &EncoderInput<'a>) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl<'a> Copy for EncoderInput<'a>

impl<'a> StructuralPartialEq for EncoderInput<'a>