List of all items

Structs

• AllowedTokens
• ConstrainedSampler
• DecodeState
• GenerationConfig
• GreedySampler
• JsonStructure
• KvCache
• QwenConfig
• QwenModel
• RotaryEmbedding
• SamplingConfig
• Shape
• SliceVocab
• StochasticSampler
• traits::CpuBackend

Enums

• AllowedSet
• ConstrainedGenerateError
• ConstraintError
• DType
• Device
• Error

Traits

• Sampler
• TokenConstraint
• TokenVocab
• traits::Backend
• traits::Model

Functions

• generate
• generate_constrained
• generate_with_sampler
• greedy_argmax
• load_matmul_weight
• load_matmul_weight_opt
• load_tensor_f32
• load_tensor_f32_opt
• mask_logits
• tensor_from_entry
• tokenizer_from_gguf

Type Aliases

• Result