Struct StreamBridge 

pub struct StreamBridge { /* private fields */ }

A bridge that connects push-based data producers with pull-based consumers.

The bridge creates a channel pair: a sender for pushing RecordBatch instances from the producer side, and a stream for pulling batches from the consumer side.

Usage

let schema = Arc::new(Schema::new(vec![...]));
let bridge = StreamBridge::new(schema, 100);
let sender = bridge.sender();

// Producer side (`LaminarDB` Reactor)
sender.send(batch).await?;

// Consumer side (`DataFusion` query)
let stream = bridge.into_stream();
while let Some(batch) = stream.next().await { ... }

Implementations

impl StreamBridge

pub fn new(schema: SchemaRef, capacity: usize) -> Self

Creates a new bridge with the given schema and channel capacity.

Arguments

• schema - Schema of RecordBatch instances that will flow through
• capacity - Maximum number of batches that can be buffered

pub fn with_default_capacity(schema: SchemaRef) -> Self

Creates a new bridge with default capacity.

pub fn schema(&self) -> SchemaRef

Returns the schema for this bridge.

pub fn sender(&self) -> BridgeSender

Returns a cloneable sender for pushing batches into the bridge.

Multiple senders can be created by cloning the returned sender.

pub fn into_stream(self) -> BridgeStream

Converts this bridge into a RecordBatchStream for DataFusion.

This consumes the bridge, taking ownership of the receiver. After calling this, you can still use senders obtained from sender().

Panics

Panics if called more than once (the receiver can only be taken once).

pub fn take_stream(&mut self) -> Option<BridgeStream>

Creates a stream without consuming the bridge.

This takes ownership of the receiver, so subsequent calls will return None.

Trait Implementations

impl Debug for StreamBridge

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.