List of all items

Structs

• AttentionPattern
• GgufSource
• ModelMetadata
• QuantTensor
• SafetensorsSource
• SamplerConfig
• SectionInfo
• TensorReader
• TfliteSource
• TokenizerSpec
• VisionConfig

Enums

• Activation
• FormatError
• QuantFormat
• RopeScaling
• TensorDtype

Traits

• ModelSource

Functions

• ensure_tokenizer_json_from_spm
• litertlm_read_sections
• open_model_source
• quants::dequantize_q4_0
• quants::dequantize_q4_k
• quants::dequantize_q5_0
• quants::dequantize_q5_k
• quants::dequantize_q6_k
• quants::dequantize_q8_0
• spm_added_tokens

Type Aliases

• Result