Struct DataStreamReader 

pub struct DataStreamReader { /* private fields */ }

DataStreamReader for reading streaming data from various sources.

Mirrors pyspark.sql.connect.streaming.DataStreamReader.

Implementations

impl DataStreamReader

pub fn format(self, source: &str) -> Self

Set the format/source type (e.g., “rate”, “socket”, “kafka”, “json”, “parquet”, “csv”).

pub fn schema(self, schema: impl Into<String>) -> Self

Set the schema from a DDL string or JSON string.

pub fn option(self, key: &str, value: &str) -> Self

Set a single option key-value pair.

pub fn options(self, options: HashMap<String, String>) -> Self

Set multiple options.

pub fn name(self, source_name: &str) -> Self

Set the source name for checkpoint stability.

pub fn load(self, path: Option<&str>) -> DataFrame

Load streaming data from the specified path(s).

pub fn table(self, table_name: &str) -> DataFrame

Read a named streaming table.

pub fn changes(self, table_name: &str) -> DataFrame

Read the streaming CDC changes of a named table. Mirrors DataStreamReader.changes (is_streaming = true).

pub fn json(self, path: &str) -> DataFrame

Read streaming JSON data from a path.

pub fn parquet(self, path: &str) -> DataFrame

Read streaming Parquet data from a path.

pub fn csv(self, path: &str) -> DataFrame

Read streaming CSV data from a path.

pub fn orc(self, path: &str) -> DataFrame

Read streaming ORC data from a path.

pub fn text(self, path: &str) -> DataFrame

Read streaming text data from a path.