Expand description
Structured Streaming support mirroring pyspark.sql.connect.streaming.
Provides DataStreamReader, DataStreamWriter, StreamingQuery, and StreamingQueryManager for building and executing streaming workloads.
Structs§
- Data
Stream Reader - DataStreamReader for reading streaming data from various sources.
- Data
Stream Writer - DataStreamWriter for writing streaming data to various sinks.
- Listener
Event Stream - An iterator over streaming query listener events from the server. Yields events incrementally as they arrive, without buffering the entire stream.
- Streaming
Query - A handle to an active streaming query.
- Streaming
Query Exception - Exception information for a streaming query.
- Streaming
Query Listener Event - A streaming-query listener event delivered by the client-side listener bus.
- Streaming
Query Manager - Manager for active streaming queries.
- Streaming
Query Status - Status information for a streaming query.
Enums§
- Trigger
- Trigger for streaming queries.
Constants§
- QUERY_
IDLE_ EVENT - QUERY_
PROGRESS_ EVENT - Event-type constants for listener events (mirror pyspark’s values).
- QUERY_
TERMINATED_ EVENT
Traits§
- Streaming
Query Listener - A client-side listener for streaming-query events. Implement this trait (Rust
clients) and register it with
StreamingQueryManager::add_listener; the manager runs a background bus that streams events from the server and dispatches them here.