Struct OptimizeBuilder 

pub struct OptimizeBuilder<'a> { /* private fields */ }

Optimize a Delta table with given options

If a target file size is not provided then delta.targetFileSize from the table’s configuration is read. Otherwise a default value is used.

Implementations

impl<'a> OptimizeBuilder<'a>

pub fn new( log_store: Arc<dyn LogStore>, snapshot: DeltaTableState, ) -> OptimizeBuilder<'a>

Create a new OptimizeBuilder

pub fn with_type(self, optimize_type: OptimizeType) -> OptimizeBuilder<'a>

Choose the type of optimization to perform. Defaults to OptimizeType::Compact.

pub fn with_filters(self, filters: &'a [PartitionFilter]) -> OptimizeBuilder<'a>

Only optimize files that return true for the specified partition filter

pub fn with_target_size(self, target: u64) -> OptimizeBuilder<'a>

Set the target file size

pub fn with_writer_properties( self, writer_properties: WriterProperties, ) -> OptimizeBuilder<'a>

Writer properties passed to parquet writer

pub fn with_commit_properties( self, commit_properties: CommitProperties, ) -> OptimizeBuilder<'a>

Additional information to write to the commit

pub fn with_preserve_insertion_order( self, preserve_insertion_order: bool, ) -> OptimizeBuilder<'a>

Whether to preserve insertion order within files

pub fn with_max_concurrent_tasks( self, max_concurrent_tasks: usize, ) -> OptimizeBuilder<'a>

Max number of concurrent tasks

pub fn with_max_spill_size(self, max_spill_size: usize) -> OptimizeBuilder<'a>

Max spill size

pub fn with_min_commit_interval( self, min_commit_interval: Duration, ) -> OptimizeBuilder<'a>

Min commit interval

pub fn with_custom_execute_handler( self, handler: Arc<dyn CustomExecuteHandler>, ) -> OptimizeBuilder<'a>

Set a custom execute handler, for pre and post execution

Trait Implementations

impl<'a> IntoFuture for OptimizeBuilder<'a>

type Output = Result<(DeltaTable, Metrics), DeltaTableError>

The output that the future will produce on completion.

type IntoFuture = Pin<Box<dyn Future<Output = <OptimizeBuilder<'a> as IntoFuture>::Output> + Send + 'a>>

Which kind of future are we turning this into?

fn into_future(self) -> <OptimizeBuilder<'a> as IntoFuture>::IntoFuture

Creates a future from a value.