toak-rs 6.0.1

A high-performance library and CLI tool for tokenizing git repositories, cleaning code, and generating embeddings
Documentation