Enum EmbeddingDType 

pub enum EmbeddingDType {
    Float32,
    Float16,
    Int8,
    Int4,
}

Embedding dtype + on-disk encoding. The two are 1:1 in v1 - float32 implies raw f32 LE, float16 implies raw f16 LE, int8 implies the quantized prefix layout (see encoding::encode_int8_embeddings), int4 implies the block-64 per-group layout (see encode_int4_embeddings).

Variants

Float32

Float16

Int8

Int4

Implementations

impl EmbeddingDType

pub fn manifest_str(self) -> &'static str

pub fn encoding(self) -> u32

Trait Implementations

impl Clone for EmbeddingDType

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for EmbeddingDType

impl Debug for EmbeddingDType

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for EmbeddingDType

impl PartialEq for EmbeddingDType

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for EmbeddingDType