Struct DataStreamReader

pub struct DataStreamReader { /* private fields */ }

DataStreamReader represents the entrypoint to create a streaming DataFrame

Implementations

impl DataStreamReader

pub fn new(spark_session: SparkSession) -> Self

pub fn format(self, format: &str) -> Self

Specifies the input data source format

pub fn schema(self, schema: &str) -> Self

Schema of the stream in DDL format (e.g. "name string, age int")

pub fn option(self, key: &str, value: &str) -> Self

Add an input option for the underlying data source

pub fn options<I, K, V>(self, options: I) -> Self

where I: IntoIterator<Item = (K, V)>, K: AsRef<str>, V: AsRef<str>,

Set many input options based on an iterator of (key/value pairs) for the underlying data source

pub fn load(self, path: Option<&str>) -> Result<DataFrame, SparkError>

Trait Implementations

impl Clone for DataStreamReader

fn clone(&self) -> DataStreamReader

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for DataStreamReader

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.