Module streaming 

Structs

ChannelPartitionStream

A partition stream that reads from an MPSC channel.

ContinuousTableInput

Schema-bound producer handle for one continuous SQL table.

Enums

ContinuousInputError

Errors returned by a continuous table producer.

Constants

CONTINUOUS_TABLE_CHANNEL_CAPACITY

Default per-continuous-table channel capacity. Bounds the in-memory queue between a producer and the DataFusion consumer: a slow consumer (e.g. an expensive join downstream) cannot cause an unbounded producer to grow memory without limit. 64 batches × ~1k rows/batch ≈ 64k rows of inflight buffering, which is enough to absorb short stalls without imposing visible backpressure on typical CDC / streaming-SQL workloads.

Functions

create_continuous_table

Creates a new continuous-table provider and its schema-bound producer. The channel is bounded (capacity CONTINUOUS_TABLE_CHANNEL_CAPACITY) so a slow DataFusion consumer applies backpressure via ContinuousTableInput::send, or ContinuousTableInput::try_send returns a resource-exhausted error.

create_continuous_table_with_capacity

Same as create_continuous_table but with a caller-supplied capacity. Useful for tests that want to exercise the full/empty channel boundary without needing to push 64 batches.