Enum ColumnData 

#[non_exhaustive]
pub enum ColumnData {
    Int64 {
        values: Vec<i64>,
        valid: Option<Vec<bool>>,
    },
    Float64 {
        values: Vec<f64>,
        valid: Option<Vec<bool>>,
    },
    Bool {
        values: Vec<bool>,
        valid: Option<Vec<bool>>,
    },
    Timestamp {
        values: Vec<i64>,
        valid: Option<Vec<bool>>,
    },
    Decimal {
        values: Vec<[u8; 16]>,
        valid: Option<Vec<bool>>,
    },
    Uuid {
        values: Vec<[u8; 16]>,
        valid: Option<Vec<bool>>,
    },
    String {
        data: Vec<u8>,
        offsets: Vec<u32>,
        valid: Option<Vec<bool>>,
    },
    Bytes {
        data: Vec<u8>,
        offsets: Vec<u32>,
        valid: Option<Vec<bool>>,
    },
    Json {
        data: Vec<u8>,
        offsets: Vec<u32>,
        valid: Option<Vec<bool>>,
    },
    Geometry {
        data: Vec<u8>,
        offsets: Vec<u32>,
        valid: Option<Vec<bool>>,
    },
    Vector {
        data: Vec<f32>,
        dim: u32,
        valid: Option<Vec<bool>>,
    },
    DictEncoded {
        ids: Vec<u32>,
        dictionary: Vec<String>,
        reverse: HashMap<String, u32>,
        valid: Option<Vec<bool>>,
    },
}

A single column’s data in the memtable.

Each variant stores a contiguous Vec of the appropriate primitive type plus an optional validity bitmap. When valid is None, all rows are considered valid — this is the fast path for non-nullable columns, eliminating one Vec::push per row and improving cache density.

When valid is Some, true = present, false = null.

Variants (Non-exhaustive)

Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.

Int64

Fields

values: Vec<i64>

valid: Option<Vec<bool>>

Float64

Fields

values: Vec<f64>

valid: Option<Vec<bool>>

Bool

Fields

values: Vec<bool>

valid: Option<Vec<bool>>

Timestamp

Fields

values: Vec<i64>

valid: Option<Vec<bool>>

Decimal

Fields

values: Vec<[u8; 16]>

Stored as 16-byte serialized representations.

valid: Option<Vec<bool>>

Uuid

Fields

values: Vec<[u8; 16]>

Stored as 16-byte binary representations.

valid: Option<Vec<bool>>

String

Fields

data: Vec<u8>

Concatenated string bytes.

offsets: Vec<u32>

Byte offsets: offset[i] is the start of string i, offset[len] is end sentinel.

valid: Option<Vec<bool>>

Bytes

Fields

data: Vec<u8>

offsets: Vec<u32>

valid: Option<Vec<bool>>

Json

JSON column: values serialized as MessagePack for structured access.

Storage layout mirrors Bytes (offset-coded variable-length data), but the variant is distinct so exhaustive match arms across the codebase are forced to handle JSON explicitly. Encoded by zerompk; decoded back to nodedb_types::Value on read so JSON path operators see a real Value::Object / Value::Array, not an opaque byte slice.

Fields

data: Vec<u8>

offsets: Vec<u32>

valid: Option<Vec<bool>>

Geometry

Fields

data: Vec<u8>

Stored as JSON-serialized geometry bytes.

offsets: Vec<u32>

valid: Option<Vec<bool>>

Vector

Fields

data: Vec<f32>

Packed f32 values: dim floats per row.

dim: u32

valid: Option<Vec<bool>>

DictEncoded

Dictionary-encoded string column: stores u32 symbol IDs + dictionary.

Low-cardinality string columns (e.g. qtype, rcode) are converted to this representation before segment flush. The IDs are delta-encoded as i64 for compact storage; the dictionary is stored in ColumnMeta.

Fields

ids: Vec<u32>

Symbol IDs per row (index into dictionary).

dictionary: Vec<String>

Dictionary: ID → string value.

reverse: HashMap<String, u32>

Reverse lookup: string → ID.

valid: Option<Vec<bool>>

Implementations

impl ColumnData

pub fn try_dict_encode( col: &ColumnData, max_cardinality: u32, ) -> Option<ColumnData>

Attempt to convert a String column to DictEncoded.

Trait Implementations

impl Clone for ColumnData

fn clone(&self) -> ColumnData

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ColumnData

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.