List of all items

Structs

• AdapterList
• GenerateRequest
• InitState
• ReloadRequest
• RuntimeInfo
• SaveRequest
• StateFile
• StateId
• StateValue
• TokenCounter
• reload::BnfOption
• reload::Lora
• reload::Model
• reload::State
• reload::Tokenizer
• run::CachedItem
• run::GenerateContext
• run::TokenSlice
• run::Tokens
• sampler::bnf::BnfSampler
• sampler::mirostat::MirostatParams
• sampler::mirostat::MirostatSampler
• sampler::mirostat::MirostatState
• sampler::nucleus::NucleusParams
• sampler::nucleus::NucleusSampler
• sampler::nucleus::NucleusState
• sampler::typical::TypicalParams
• sampler::typical::TypicalSampler
• sampler::typical::TypicalState

Enums

• Environment
• FinishReason
• GenerateKind
• InputState
• ThreadRequest
• Token
• reload::AdapterOption
• reload::Precision
• run::CachedPrompt

Traits

• ModelSerialize
• run::AsTokenSlice
• sampler::Formatter
• sampler::Sampler

Functions

• run::run
• serve

Constants

• MAX_TOKENS