gtars-tokenizers-0.5.2
- gtars-tokenizers 0.5.2
- Permalink
- Docs.rs crate page
- MIT
- Links
- Repository
- crates.io
- Source
- Owners
- nleroy917
- Dependencies
- anyhow ^1.0.82 normal
  fxhash ^0.2.1 normal
  gtars-core ^0.5.1 normal
  gtars-overlaprs ^0.5.0 normal
  hf-hub ^0.4.3 normal optional
  serde ^1.0.203 normal
  thiserror ^2.0.12 normal
  toml ^0.8.14 normal
  pretty_assertions ^1.4.1 dev
  rstest ^0.26.1 dev
- Versions
- 15.7% of the crate is documented
Platform
Feature flags

docs.rs

Rust

Module encoding

gtars_tokenizers0.5.2

Module encoding

Module Items

Structs

In crate gtars_tokenizers

gtars_tokenizers

Module encoding

Structs§

BatchEncoding
Encoding