Struct datafusion::config::ExecutionOptions
source · pub struct ExecutionOptions {
pub batch_size: usize,
pub coalesce_batches: bool,
pub collect_statistics: bool,
pub target_partitions: usize,
pub time_zone: Option<String>,
pub parquet: ParquetOptions,
pub aggregate: AggregateOptions,
pub planning_concurrency: usize,
}
Expand description
Options related to query execution
Fields (Non-exhaustive)§
This struct is marked as non-exhaustive
Struct { .. }
syntax; cannot be matched against without a wildcard ..
; and struct update syntax will not work.batch_size: usize
Default batch size while creating new batches, it’s especially useful for buffer-in-memory batches since creating tiny batches would result in too much metadata memory consumption
coalesce_batches: bool
When set to true, record batches will be examined between each operator and small batches will be coalesced into larger batches. This is helpful when there are highly selective filters or joins that could produce tiny output batches. The target batch size is determined by the configuration setting
collect_statistics: bool
Should DataFusion collect statistics after listing files
target_partitions: usize
Number of partitions for query execution. Increasing partitions can increase concurrency.
Defaults to the number of CPU cores on the system
time_zone: Option<String>
The default time zone
Some functions, e.g. EXTRACT(HOUR from SOME_TIME)
, shift the underlying datetime
according to this time zone, and then extract the hour
parquet: ParquetOptions
Parquet options
aggregate: AggregateOptions
Aggregate options
planning_concurrency: usize
Fan-out during initial physical planning.
This is mostly use to plan UNION
children in parallel.
Defaults to the number of CPU cores on the system
Trait Implementations§
source§impl Clone for ExecutionOptions
impl Clone for ExecutionOptions
source§fn clone(&self) -> ExecutionOptions
fn clone(&self) -> ExecutionOptions
1.0.0 · source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source
. Read more