copyforward-0.2.1
- copyforward 0.2.1
- Permalink
- Docs.rs crate page
- MIT
- 19 September 2026
- Links
- crates.io
- Source
- Owners
- SeanTater
- Dependencies
- ahash ^0.8.12 normal
  cffi ^0.1.7 normal optional
  numpy ^0.20 normal optional
  pyo3 ^0.20 normal optional
  rand ^0.8 normal
  rand_chacha ^0.3 normal
  smallvec ^1.15.1 normal
  tokenizers ^0.15 normal optional
  criterion ^0.5 dev
- Versions
- 84.62% of the crate is documented
Platform
- x86_64-unknown-linux-gnu
Feature flags

docs.rs

Rust

Skip to main content

All

copyforward0.2.1

Crate Items

Structs
Enums
Traits
Functions
Type Aliases

List of all items

Structs

Approximate
Exact
core::Config
tokenization::WhitespaceTokenizer

Enums

core::Segment
core::TokenSegment

Traits

MessageLike
TokenLike
core::CopyForward
core::CopyForwardTokens
tokenization::Tokenize

Functions

approximate
approximate_tokens
exact
exact_tokens
fixture::generate_thread
hashing::prefix_hashes
hashing::prefix_hashes_u32
hashing::range_hash
tokenization::get_tokenizer

Type Aliases

ApproximateTokens
ExactTokens