Crate gpt_model

Source
Expand description

Pure Rust inference wrapper for the GPT-2 (and possibly later) model family.

Modules§

model
Runtime wrappers for running inference on a GPT model saved in ONNX format.
tokenizer
Pure Rust implementation of the GPT-2 byte-pair encoder (aka “text tokenizer”).