Type Alias DatumByteToTokenPipeline 

pub type DatumByteToTokenPipeline<B> = DatumComposePipe<DatumUTF8Decoder, DatumCharToTokenPipeline<B>>;

Byte to token parsing pipeline (custom storage) Added in 1.1.0.

Aliased Type

pub struct DatumByteToTokenPipeline<B>(pub DatumUTF8Decoder, pub DatumComposePipe<DatumDecoder, DatumPipeTokenizer<B>>);

Tuple Fields

0: DatumUTF8Decoder

1: DatumComposePipe<DatumDecoder, DatumPipeTokenizer<B>>