Expand description
Pure Rust inference wrapper for the GPT-2 (and possibly later) model family.
Modules§
- Runtime wrappers for running inference on a GPT model saved in ONNX format.
- Pure Rust implementation of the GPT-2 byte-pair encoder (aka “text tokenizer”).