rten-generate 0.11.0

Utilities to simplify running auto-regressive models with RTen
Documentation

Utilities to simplify running auto-regressive RTen models such as transformer decoders.

For working examples, see the examples in the rten-examples crate which import rten_generate.