Structs§
- Block
Iq1M - Block
Iq1S - Block
Iq2S - Block
Iq2XS - Block
Iq2XXS - Block
Iq3S - Block
Iq3XXS - Block
Iq4NL - Block
Iq4XS - Block
Q2K - Block
Q3K - Block
Q4K - Block
Q4_ 0 - Block
Q4_ 0x4 - Block
Q4_ 0x8 - Block
Q4_ 1 - Block
Q5K - Block
Q5_ 0 - Block
Q5_ 1 - Block
Q6K - Block
Q8K - Block
Q8_ 0 - Block
Q8_ 0x4 - Block
Q8_ 0x8 - Block
Q8_ 1 - Block
Tq1_ 0 - Block
Tq2_ 0 - GGUF
- GGUF
Float Tensor - GGUF
Header - GGUF
IntTensor - GGUF
Metadata Kv - GGUF
Parser - GGUF
Tensor Meta