List of all items

Structs

• CudaDevice
• CudaStorage
• StridedIndex
• Tensor
• TensorId
• Var
• backprop::GradStore
• cpu_backend::CpuDevice
• display::PrinterOptions
• error::MatMulUnexpectedStriding
• layout::ContiguousOffsetsWithBroadcast
• layout::Layout
• npy::NpzTensors
• pickle::PthTensors
• pickle::Stack
• pickle::TensorInfo
• quantized::QMatMul
• quantized::QTensor
• quantized::ggml_file::Content
• quantized::ggml_file::HParams
• quantized::ggml_file::Vocab
• quantized::gguf_file::Content
• quantized::gguf_file::TensorInfo
• quantized::k_quants::BlockQ2K
• quantized::k_quants::BlockQ3K
• quantized::k_quants::BlockQ4K
• quantized::k_quants::BlockQ4_0
• quantized::k_quants::BlockQ4_1
• quantized::k_quants::BlockQ5K
• quantized::k_quants::BlockQ5_0
• quantized::k_quants::BlockQ5_1
• quantized::k_quants::BlockQ6K
• quantized::k_quants::BlockQ8K
• quantized::k_quants::BlockQ8_0
• quantized::k_quants::BlockQ8_1
• safetensors::MmapedFile
• shape::Shape

Enums

• DType
• Device
• DeviceLocation
• Storage
• StridedBlocks
• cpu_backend::CpuStorage
• error::Error
• pickle::Object
• pickle::OpCode
• quantized::GgmlDType
• quantized::ggml_file::VersionedMagic
• quantized::gguf_file::Value
• quantized::gguf_file::ValueType
• quantized::gguf_file::VersionedMagic
• shape::D

Traits

• CustomOp1
• CustomOp2
• CustomOp3
• FloatDType
• IndexOp
• IntDType
• Module
• ToUsize2
• WithDType
• backend::BackendDevice
• backend::BackendStorage
• cpu::kernels::VecOps
• cpu_backend::Map1
• cpu_backend::Map1Any
• cpu_backend::Map2
• cpu_backend::Map2U8
• quantized::QuantizedType
• quantized::k_quants::GgmlType
• safetensors::Load
• shape::Dim
• shape::Dims

Macros

• bail
• map_dtype
• test_device

Functions

• cpu::kernels::par_for_each
• cpu::kernels::par_range
• cpu_backend::unary_map
• cpu_backend::unary_map_vec
• display::set_print_options
• display::set_print_options_default
• display::set_print_options_full
• display::set_print_options_short
• error::zip
• pickle::read_pth_tensor_info
• quantized::ggml_file::qtensor_from_ggml
• quantized::gguf_file::write
• quantized::k_quants::matmul
• safetensors::load
• safetensors::load_buffer
• safetensors::save
• shape::dims0
• shape::dims1
• shape::dims2
• shape::dims3
• shape::dims4
• shape::dims5
• test_utils::to_vec0_round
• test_utils::to_vec1_round
• test_utils::to_vec2_round
• test_utils::to_vec3_round
• utils::cuda_is_available
• utils::get_num_threads
• utils::has_accelerate
• utils::has_mkl
• utils::with_avx
• utils::with_f16c
• utils::with_neon
• utils::with_simd128

Type Aliases

• error::Result

Constants

• quantized::gguf_file::DEFAULT_ALIGNMENT
• quantized::k_quants::K_SCALE_SIZE
• quantized::k_quants::QK4_0
• quantized::k_quants::QK4_1
• quantized::k_quants::QK5_0
• quantized::k_quants::QK5_1
• quantized::k_quants::QK8_0
• quantized::k_quants::QK8_1
• quantized::k_quants::QK_K
• shape::SCALAR