bpe-openai-0.2.1
- bpe-openai 0.2.1
- Docs.rs crate page
- MIT
- Links
- Repository
- crates.io
- Source
- Owners
- hendrikvanantwerpen
- gorzell
- aneubeck
- Dependencies
- bpe ^0.2.0 normal
  
  either ^1.13 normal
  
  regex-automata ^0.4 normal
  
  rmp-serde ^1 normal
  
  bpe ^0.2.0 dev
  
  tiktoken-rs ^0.6 dev
  
  base64 ^0.22.1 build
  
  bpe ^0.2.0 build
  
  flate2 ^1.0 build
  
  rmp-serde ^1 build
  
  serde ^1 build
- Versions
- 73.33% of the crate is documented
Go to latest version
Platform
Feature flags

docs.rs

Rust

bpe_openai0.2.1

Module appendable_encoder

Module Items

Structs

In crate bpe_openai

Module appendable_encoder

Structs§

AppendableEncoder: Encoder which keeps track of the encoding length while appending characters.