Expand description
Tokenizations alignment functions.
Functions§
- get_
alignments - Returns the tokenizations alignments
a2b(fromatob) andb2a(frombtoa) based on the shortest edit script (SES). - get_
charmap - Returns the character mappings
c_a2b(fromatob) andc_b2a(frombtoa) based on the shortest edit script (SES). - get_
original_ spans Deprecated