Struct Trainer 

pub struct Trainer { /* private fields */ }

High-level façade configuring and executing BPE training runs.

Implementations

impl Trainer

pub fn new(cfg: TrainerConfig) -> Self

Creates a new trainer for the supplied configuration.

pub fn builder() -> TrainerBuilder

Returns a TrainerBuilder with default settings.

pub fn config(&self) -> &TrainerConfig

Returns an immutable reference to the underlying configuration.

pub fn train_from_paths<P: AsRef<Path>>( &self, inputs: &[P], ingest: &IngestConfig, ) -> Result<TrainerArtifacts>

Trains a model by loading files from disk according to IngestConfig.

pub fn train_from_sequences( &self, sequences: &[Vec<u8>], ) -> Result<TrainerArtifacts>

Trains a model from in-memory byte sequences.

Trait Implementations

impl Clone for Trainer

fn clone(&self) -> Trainer

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Trainer

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.