splintr 0.9.0

Fast Rust tokenizer (BPE + SentencePiece + WordPiece) with Python bindings
Documentation