Crate gpt_model

Pure Rust inference wrapper for the GPT-2 (and possibly later) model family.

Modules

model

Runtime wrappers for running inference on a GPT model saved in ONNX format.

tokenizer

Pure Rust implementation of the GPT-2 byte-pair encoder (aka “text tokenizer”).