rten-generate 0.25.0

Utilities to simplify running auto-regressive models with RTen
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23

//! Utilities to simplify running auto-regressive [RTen][rten] models such
//! as transformer decoders.
//!
//! For working examples, see the examples in the [rten-examples][rten-examples]
//! crate which import `rten_generate`.
//!
//! [rten]: https://github.com/robertknight/rten
//! [rten-examples]: https://github.com/robertknight/rten/tree/main/rten-examples

pub mod filter;
pub mod generator;
mod logits;
pub mod metrics;
pub mod model;
pub mod sampler;

#[cfg(feature = "text-decoder")]
pub mod text_decoder;

pub use generator::{
    Generator, GeneratorConfig, GeneratorError, GeneratorUtils, ModelInputsConfig,
};
pub use logits::Logits;