Type Alias BoxedTokenizer 

pub type BoxedTokenizer = Arc<dyn HydraTokenizer>;

Type-erased tokenizer for storing different tokenizer implementations.

Aliased Type

pub struct BoxedTokenizer { /* private fields */ }