List of all items

Structs

• Logits
• filter::Chain
• filter::Sort
• filter::Temperature
• filter::TopK
• filter::TopP
• generator::Generator
• generator::GeneratorConfig
• generator::KVCachePair
• generator::KVCachePattern
• generator::ModelInputsConfig
• metrics::Metrics
• model::NodeInfo
• sampler::ArgMax
• sampler::Multinomial
• text_decoder::TextDecoder
• text_decoder::TextDecoderWithIds

Enums

• generator::GeneratorError

Traits

• filter::LogitsFilter
• generator::GeneratorUtils
• model::Model
• sampler::Sampler

Functions

• filter::token_id_filter

Type Aliases

• generator::GeneratorItem
• generator::TokenId