Crate tokenizations

Tokenizations alignment functions.

Functions

get_alignments	Returns tokenizations alignments a2b (from a to b) and b2a (from b to a) based on shortest edit script (SES).
get_charmap	Returns character mappings c_a2b (from a to b) and c_b2a (from b to a) based on shortest edit script (SES).

Type Definitions

Alignment
CharMap