Crate gpt_model

source ·
Expand description

Pure Rust inference wrapper for the GPT-2 (and possibly later) model family.

Modules§

  • Runtime wrappers for running inference on a GPT model saved in ONNX format.
  • Pure Rust implementation of the GPT-2 byte-pair encoder (aka “text tokenizer”).