List of all items
Structs
- chunked_prefill::ChunkedPrefillConfig
- chunked_prefill::ChunkedPrefillScheduler
- chunked_prefill::PrefillTask
- model::SyntheticModel
- pipeline::SpeculativeConfig
- pipeline::SpeculativePipeline
- prompt_lookup::PromptLookupConfig
- prompt_lookup::PromptLookupEngine
- quantization::QuantizedLinearModel
- scheduler::ContinuousBatchScheduler
- scheduler::QueuedRequest
- scheduler::SchedulerStats
- stream::SpeculativeStream
- tree_pipeline::TreeSpeculativeConfig
- tree_pipeline::TreeSpeculativePipeline
- weights::GgufMetadata
- weights::GgufTensorInfo
- weights::LinearProjectionModel
- weights::SafeTensorEntry
- weights::SafeTensorsMetadata
Enums
Traits
Functions
- quantization::dequantize_q4_0
- quantization::dequantize_q8_0
- quantization::f16_to_f32
- quantization::f32_to_f16
- quantization::quantize_q8_0_block
- quantization::vec_dot_q4_0
- quantization::vec_dot_q8_0
- quantization::vec_dot_q8_0_scalar