Skip to main content

Module live_source

Module live_source 

Source
Expand description

Live source provider for streaming execution with plan caching Swappable table provider that eliminates per-cycle catalog churn and enables physical plan caching.

Register a LiveSourceProvider once at pipeline startup. Each cycle, swap batches via LiveSourceHandle, then execute the cached physical plan. The internal LiveSourceExec reads from the shared slot at execute() time, so the cached plan always sees fresh data.

Structsยง

LiveSourceHandle
Handle for swapping batches into a LiveSourceProvider.
LiveSourceProvider
Swappable TableProvider for streaming micro-batch execution.