List of all items

Structs

• bitnet::I2sBlock
• calibration::CalibrationData
• inference::QuantizedLinear
• inference::QuantizedModel
• quantize::QuantizationStats
• types::Q4Block
• types::Q4_1Block
• types::Q5Block
• types::Q5_1Block
• types::Q8Block
• types::QuantizedTensor

Enums

• calibration::CalibrationMethod
• error::QuantError
• types::QuantType
• types::QuantizedBlock

Functions

• bitnet::bytes_for_elements
• bitnet::decode_trit
• bitnet::dequantize_i2s
• bitnet::dequantize_i2s_block
• bitnet::matmul_i2s
• bitnet::matmul_i2s_i8
• bitnet::quantize_row_to_int8
• calibration::calibrate
• calibration::calibrate_batch
• dequantize::dequantize_block
• dequantize::dequantize_tensor
• inference::deserialize_quantized
• inference::quantize_parameters
• inference::serialize_quantized
• quantize::compute_quantization_error
• quantize::compute_quantization_stats
• quantize::quantize_model
• quantize::quantize_tensor

Type Aliases

• error::QuantResult

Constants

• DEFAULT_BLOCK_SIZE
• MAX_BLOCK_SIZE
• bitnet::I2S_BLOCK_SIZE
• bitnet::I2S_BYTES_PER_BLOCK
• bitnet::I2S_GROUP_SIZE