iceberg_rust::arrow::write

Function write_parquet_partitioned

Source 
pub async fn write_parquet_partitioned(
    table: &Table,
    batches: impl Stream<Item = Result<RecordBatch, ArrowError>> + Send + 'static,
    branch: Option<&str>,
) -> Result<Vec<DataFile>, ArrowError>
Expand description

Writes Arrow record batches as partitioned Parquet files.

This function writes Arrow record batches to Parquet files, partitioning them according to the table’s partition spec.

§Arguments

  • table - The Iceberg table to write data for
  • batches - Stream of Arrow record batches to write
  • branch - Optional branch name to write to

§Returns

  • Result<Vec<DataFile>, ArrowError> - List of metadata for the written data files

§Errors

Returns an error if:

  • The table metadata cannot be accessed
  • The schema projection fails
  • The object store operations fail
  • The Parquet writing fails
  • The partition path generation fails