List of all items

Structs

• ChatOptions
• ChatResponse
• DownloadRequest
• DownloadResult
• HuggingFaceStorage
• KnownModel
• LoadConfig
• ModelInfo
• PullProgress
• inference::ChatOptions
• inference::ChatResponse
• inference::LoadConfig
• inference::ModelInfo
• inference::NativeRuntime

Enums

• BackendError
• ModelArchitecture
• ModelType
• NativeError
• Quantization
• ResolvedModel

Traits

• ModelStorage
• inference::DynInferenceBackend
• inference::InferenceBackend

Functions

• auto_select_quantization
• default_model_dir
• detect_available_ram_gb
• extract_quantization
• find_model
• resolve_model

Type Aliases

• ProgressCallback
• Result