Struct DataFrameWriterV2 

pub struct DataFrameWriterV2 { /* private fields */ }

DataFrameWriterV2 for the v2 write API (DataFrame.writeTo).

Mirrors pyspark.sql.connect.readwriter.DataFrameWriterV2.

Implementations

impl DataFrameWriterV2

pub fn cluster_by<S: Into<String>>( self, cols: impl IntoIterator<Item = S>, ) -> Self

Cluster the output table by the given columns (liquid clustering).

pub fn using(self, provider: &str) -> Self

Specify the underlying output data source provider (e.g. “parquet”).

pub fn option(self, key: &str, value: &str) -> Self

Add a write option.

pub fn options(self, options: HashMap<String, String>) -> Self

Add multiple write options.

pub fn table_property(self, property: &str, value: &str) -> Self

Add a table property.

pub fn partition_by<C: Into<Column>>( self, columns: impl IntoIterator<Item = C>, ) -> Self

Partition the output table by the given columns.

pub fn create(self) -> Result<()>

Create a new table from the DataFrame.

pub fn replace(self) -> Result<()>

Replace an existing table with the DataFrame.

pub fn create_or_replace(self) -> Result<()>

Create the table, or replace it if it already exists.

pub fn append(self) -> Result<()>

Append the DataFrame’s rows to the table.

pub fn overwrite(self, condition: Column) -> Result<()>

Overwrite rows matching condition with the DataFrame’s rows.

pub fn overwrite_partitions(self) -> Result<()>

Overwrite all partitions touched by the DataFrame (dynamic overwrite).