Skip to main content

start_buffer

scouter_dataframe::parquet::bifrost::buffer

Function start_buffer 

Source 
pub fn start_buffer(
    engine_tx: Sender<TableCommand>,
    batch_rx: Receiver<RecordBatch>,
    shutdown_rx: Receiver<()>,
    flush_interval_secs: u64,
    max_buffer_rows: usize,
    table_fqn: String,
) -> JoinHandle<()>
Expand description

Per-table buffer actor that accumulates RecordBatch objects and flushes them to the engine actor on capacity or timer triggers.

Sends Vec<RecordBatch> directly to the engine — Delta Lake’s write() accepts multiple batches natively, avoiding concat_batches copies.