Struct DataFrameWriter 

pub struct DataFrameWriter<'a> { /* private fields */ }

Builder for writing DataFrame to path (PySpark DataFrameWriter).

Implementations

impl<'a> DataFrameWriter<'a>

pub fn mode(self, mode: WriteMode) -> Self

pub fn format(self, format: WriteFormat) -> Self

pub fn option(self, key: impl Into<String>, value: impl Into<String>) -> Self

Add a single option (PySpark: option(key, value)). Returns self for chaining.

pub fn options(self, opts: impl IntoIterator<Item = (String, String)>) -> Self

Add multiple options (PySpark: options(**kwargs)). Returns self for chaining.

pub fn partition_by( self, cols: impl IntoIterator<Item = impl Into<String>>, ) -> Self

Partition output by the given columns (PySpark: partitionBy(cols)).

pub fn save_as_table( &self, session: &SparkSession, name: &str, mode: SaveMode, ) -> Result<(), PolarsError>

Save the DataFrame as a table (PySpark: saveAsTable). In-memory by default; when spark.sql.warehouse.dir is set, persists to disk for cross-session access.

pub fn parquet(&self, path: impl AsRef<Path>) -> Result<(), PolarsError>

Write as Parquet (PySpark: parquet(path)). Equivalent to format(Parquet).save(path).

pub fn csv(&self, path: impl AsRef<Path>) -> Result<(), PolarsError>

Write as CSV (PySpark: csv(path)). Equivalent to format(Csv).save(path).

pub fn json(&self, path: impl AsRef<Path>) -> Result<(), PolarsError>

Write as JSON lines (PySpark: json(path)). Equivalent to format(Json).save(path).

pub fn save(&self, path: impl AsRef<Path>) -> Result<(), PolarsError>

Write to path. Overwrite replaces; append reads existing (if any) and concatenates then writes. With partition_by, path is a directory; each partition is written as path/col1=val1/col2=val2/… with partition columns omitted from the file (Spark/Hive style).