Struct ModelDoc 

pub struct ModelDoc {
    pub name: &'static str,
    pub exact: bool,
}

A supported tokenizer/model.

Fields

name: &'static str

Display name (tokenizer family).

exact: bool

Whether this build counts it exactly (a real BPE) vs. an estimate.

Trait Implementations

impl Clone for ModelDoc

fn clone(&self) -> ModelDoc

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ModelDoc

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Serialize for ModelDoc

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.