Expand description
Live source provider for streaming execution with plan caching Swappable table provider that eliminates per-cycle catalog churn and enables physical plan caching.
Register a LiveSourceProvider once at pipeline startup. Each cycle,
swap batches via LiveSourceHandle, then execute the cached physical
plan. The internal LiveSourceExec reads from the shared slot at execute() time,
so the cached plan always sees fresh data.
Structsยง
- Live
Source Handle - Handle for swapping batches into a
LiveSourceProvider. - Live
Source Provider - Swappable
TableProviderfor streaming micro-batch execution.