tiktoken-rust-0.2.1
- tiktoken-rust 0.2.1
- Permalink
- Docs.rs crate page
- MIT
- Links
- Repository
- crates.io
- Source
- Owners
- darknight
- Dependencies
- base64ct ^1.6.0 normal
  
  bstr ^1.0.1 normal
  
  fancy-regex ^0.11.0 normal
  
  once_cell ^1.17.1 normal
  
  rayon ^1.7 normal
  
  regex ^1.7.0 normal
  
  reqwest ^0.11 normal
  
  rustc-hash ^1.1.0 normal
  
  serde_json ^1.0 normal
  
  sha2 ^0.10 normal
  
  thiserror ^1.0 normal
  
  uuid ^1.3.1 normal
- Versions
- 16% of the crate is documented
Platform
Feature flags

docs.rs

Rust

tiktoken_rust0.2.1

Crate Items

Structs
Enums
Functions
Type Aliases

List of all items

Structs

Encoding

Enums

AllowedSpecial
DecodeMode
DisallowedSpecial
EncodeError

Functions

encoding_for_model
get_encoding
list_encoding_names

Type Aliases

Result