Struct ColumnarEngine 

pub struct ColumnarEngine<S: StorageEngine> { /* private fields */ }

Manages all columnar collections for a NodeDbLite instance.

Implementations

impl<S: StorageEngine> ColumnarEngine<S>

pub async fn try_compact_collection( &self, collection: &str, ) -> Result<bool, LiteError>

Check if any segments need compaction and run it.

pub async fn purge_bitemporal_before( &self, collection: &str, cutoff_ms: i64, ) -> Result<u64, LiteError>

Purge fully-deleted segment tombstones for a bitemporal collection where fully_deleted_at_ms < cutoff_ms. Non-bitemporal collections always return rows_affected: 0 — they have no tombstones.

Returns the number of tombstoned segment entries removed.

impl<S: StorageEngine> ColumnarEngine<S>

pub async fn flush_collection(&self, collection: &str) -> Result<(), LiteError>

Flush the memtable for a collection to a new segment.

pub async fn flush_all(&self) -> Result<(), LiteError>

Flush all collections’ memtables.

impl<S: StorageEngine> ColumnarEngine<S>

pub fn new(storage: Arc<S>, memory: ScopedMemory) -> Self

Create a new empty columnar engine.

pub fn set_outbound(&mut self, outbound: Arc<ColumnarOutbound<S>>)

Attach a sync outbound queue for plain columnar collections.

Must be called before any inserts if columnar sync is desired.

pub fn set_timeseries_outbound(&mut self, outbound: Arc<TimeseriesOutbound<S>>)

Attach a sync outbound queue for timeseries-profile collections.

When set, inserts into collections with ColumnarProfile::Timeseries are routed here instead of outbound, so the transport can send them as TimeseriesPush frames to Origin’s timeseries engine.

pub async fn restore( storage: Arc<S>, memory: ScopedMemory, ) -> Result<Self, LiteError>

Restore columnar collections from storage on startup.

impl<S: StorageEngine> ColumnarEngine<S>

pub fn insert( &self, collection: &str, values: &[Value], ) -> Result<(), LiteError>

Insert a row into a columnar collection’s memtable.

This is a pure in-memory operation. Call [enqueue_outbound] from an async context after inserting to durably enqueue the row for replication to Origin.

pub async fn enqueue_outbound( &self, collection: &str, rows: &[Vec<Value>], ) -> Result<(), LiteError>

Durably enqueue a batch of inserted rows for replication to Origin.

Must be called from an async context after one or more successful [insert] calls. Timeseries-profile collections are routed to the timeseries_outbound queue; all other columnar collections use the plain outbound queue.

Returns LiteError::Backpressure when the queue is at cap so the caller can propagate back-pressure. Other enqueue errors are logged as warnings (the local insert already succeeded) and Ok(()) is returned.

pub fn delete(&self, collection: &str, pk: &Value) -> Result<bool, LiteError>

Delete a row by PK.

pub fn update( &self, collection: &str, old_pk: &Value, new_values: &[Value], ) -> Result<bool, LiteError>

Update a row: DELETE old + INSERT new.

impl<S: StorageEngine> ColumnarEngine<S>

pub async fn list_rows( &self, collection: &str, ) -> Result<Vec<Vec<Value>>, LiteError>

Scan all rows in a columnar collection, returning them in schema column order.

Reads memtable rows first, then flushed segments. Each row is a Vec<Value> whose entries correspond 1-to-1 with schema().columns.

pub async fn read_segments( &self, collection: &str, ) -> Result<Vec<(u32, Vec<u8>)>, LiteError>

Read all segment bytes for a collection (for the table provider).

pub fn delete_bitmap( &self, collection: &str, segment_id: u32, ) -> Option<DeleteBitmap>

Get the delete bitmap for a segment (returns a clone).

pub fn row_count(&self, collection: &str) -> usize

Row count across all segments + memtable for a collection.

pub fn is_bitemporal(&self, collection: &str) -> bool

Whether a collection has bitemporal tracking enabled.

impl<S: StorageEngine> ColumnarEngine<S>

pub async fn create_collection( &self, name: &str, schema: ColumnarSchema, profile: ColumnarProfile, bitemporal: bool, ) -> Result<(), LiteError>

Create a new columnar collection.

pub async fn drop_collection(&self, name: &str) -> Result<(), LiteError>

Drop a columnar collection and all its data.

pub async fn alter_add_column( &self, name: &str, column: ColumnDef, ) -> Result<(), LiteError>

Add a column to an existing columnar collection.

pub fn schema(&self, name: &str) -> Option<ColumnarSchema>

Get the schema for a collection (returns a clone).

pub fn profile(&self, name: &str) -> Option<ColumnarProfile>

Get the profile for a collection (returns a clone).

pub fn collection_names(&self) -> Vec<String>

List all columnar collection names.

impl<S: StorageEngine> ColumnarEngine<S>

pub async fn truncate(&self, collection: &str) -> Result<usize, LiteError>

Remove every row of collection: the memtable, the primary-key index, every delete bitmap, every bitemporal version, and every flushed segment with its metadata. Returns the number of rows that existed across the memtable and live segments.

Errors when collection is not a columnar collection.