Structs§
- GGUF
Container - GGUF file container.
- GGUF
Model - GGUF model.
- Tensor
- Tensor in the GGUF file.
- V1
- Version 1 of the GGUF file.
- V2
- Version 2 of the GGUF file.
- V3
- Version 3 of the GGUF file.
Enums§
- Byte
Order - Byte order of the GGUF file.
- GGML
Type - GGML type of a tensor in the GGUF file.
- Metadata
Value Type - Version
- Version of the GGUF file.
Constants§
- FILE_
MAGIC_ GGJT - Magic constant for
ggml
files (versioned, ggjt). - FILE_
MAGIC_ GGLA - Magic constant for
ggla
files (LoRA adapter). - FILE_
MAGIC_ GGMF - Magic constant for
ggml
files (versioned, ggmf). - FILE_
MAGIC_ GGML - Magic constant for
ggml
files (unversioned). - FILE_
MAGIC_ GGUF_ BE - FILE_
MAGIC_ GGUF_ LE - Magic constant for
gguf
files (versioned, gguf)
Functions§
- get_
gguf_ container - Get a
GGUFContainer
from a file.