Struct DataFrameReader 

pub struct DataFrameReader { /* private fields */ }

DataFrameReader for reading various file formats Similar to PySpark’s DataFrameReader with option/options/format/load/table

Implementations

impl DataFrameReader

pub fn new(session: SparkSession) -> Self

pub fn option(self, key: impl Into<String>, value: impl Into<String>) -> Self

Add a single option (PySpark: option(key, value)). Returns self for chaining.

pub fn options(self, opts: impl IntoIterator<Item = (String, String)>) -> Self

Add multiple options (PySpark: options(**kwargs)). Returns self for chaining.

pub fn format(self, fmt: impl Into<String>) -> Self

Set the format for load() (PySpark: format(“parquet”) etc).

pub fn schema(self, _schema: impl Into<String>) -> Self

Set the schema (PySpark: schema(schema)). Stub: stores but does not apply yet.

pub fn load(&self, path: impl AsRef<Path>) -> Result<DataFrame, PolarsError>

Load data from path using format (or infer from extension) and options.

pub fn table(&self, name: &str) -> Result<DataFrame, PolarsError>

Return the named table/view (PySpark: table(name)).

pub fn csv(&self, path: impl AsRef<Path>) -> Result<DataFrame, PolarsError>

pub fn parquet(&self, path: impl AsRef<Path>) -> Result<DataFrame, PolarsError>

pub fn json(&self, path: impl AsRef<Path>) -> Result<DataFrame, PolarsError>