List of all items

Structs

• device::DeviceConfig
• loaders::gguf::LoaderGguf
• loaders::gguf::LoaderGgufInfo
• loaders::gguf::LoaderGgufInfoSource
• loaders::gguf::LoaderGgufInfoTokenizer
• loaders::gguf::llama::LoaderGgufInfoModelLlama
• loaders::gguf::llama::LoaderGgufInfoModelLlamaAttention
• loaders::gguf::llama::LoaderGgufInfoModelLlamaRope
• loaders::safetensors::LoaderSafetensors
• models::llama::ModelLlama
• models::llama_quantized::ModelLlamaQuantized
• models::mistral::ModelMistral
• models::phi3::ModelPhi3
• models::qwen2::ModelQwen2
• pipelines::text::PipelineText
• pipelines::text::PipelineTextBuilder
• templates::dummy::TemplateDummy
• templates::jinja::TemplateJinja

Enums

• device::Device
• error::CallmError
• loaders::gguf::LoaderGgufInfoModel
• models::ModelArchitecture
• templates::MessageRole

Traits

• loaders::LoaderImpl
• models::ModelImpl
• templates::TemplateImpl

Functions

• loaders::gguf::llama::parse_llama_kv
• utils::autodetect_loader