splintr 0.14.4

Fast Rust tokenizer (BPE + SentencePiece + WordPiece) with Python bindings
Documentation