Crate tokenizations[−][src]
Tokenizations alignment functions.
Functions
get_alignments | Returns the tokenizations alignments |
get_charmap | Returns the character mappings |
get_original_spans | Deprecated |
Type Definitions
Alignment | |
CharMap |
Tokenizations alignment functions.
get_alignments | Returns the tokenizations alignments |
get_charmap | Returns the character mappings |
get_original_spans | Deprecated |
Alignment | |
CharMap |