pub enum RowGroupStrategy {
Auto,
FixedRows,
FixedMemory,
}Expand description
Parquet row group tuning strategy.
Controls how many rows Rivet places in each Parquet row group. Row group size affects memory usage during write, compression ratio, and downstream read performance (predicate pushdown, column skipping).
exports:
- name: events
parquet:
row_group_strategy: auto # compute from schema + target_row_group_mb
target_row_group_mb: 128 # default target; auto + fixed_memory only
max_row_group_mb: 256 # optional upper bound (all strategies)
# row_group_strategy: fixed_rows # exact row count
# row_group_rows: 500000 # used with fixed_rows
# row_group_strategy: fixed_memory # same math as auto, made explicitVariants§
Auto
Compute rows-per-group from schema column types and target_row_group_mb.
For narrow tables this produces large groups (efficient). For wide tables
it reduces group size to stay within the memory target.
FixedRows
Use row_group_rows as a literal row count. Ignores memory targets.
FixedMemory
Identical math to auto, but the strategy label is explicit in logs.
Trait Implementations§
Source§impl Clone for RowGroupStrategy
impl Clone for RowGroupStrategy
Source§fn clone(&self) -> RowGroupStrategy
fn clone(&self) -> RowGroupStrategy
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for RowGroupStrategy
impl Debug for RowGroupStrategy
Source§impl Default for RowGroupStrategy
impl Default for RowGroupStrategy
Source§fn default() -> RowGroupStrategy
fn default() -> RowGroupStrategy
Returns the “default value” for a type. Read more
Source§impl<'de> Deserialize<'de> for RowGroupStrategy
impl<'de> Deserialize<'de> for RowGroupStrategy
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl JsonSchema for RowGroupStrategy
impl JsonSchema for RowGroupStrategy
Source§fn schema_id() -> Cow<'static, str>
fn schema_id() -> Cow<'static, str>
Returns a string that uniquely identifies the schema produced by this type. Read more
Source§fn json_schema(generator: &mut SchemaGenerator) -> Schema
fn json_schema(generator: &mut SchemaGenerator) -> Schema
Generates a JSON Schema for this type. Read more
Source§fn inline_schema() -> bool
fn inline_schema() -> bool
Whether JSON Schemas generated for this type should be included directly in parent schemas,
rather than being re-used where possible using the
$ref keyword. Read moreSource§impl PartialEq for RowGroupStrategy
impl PartialEq for RowGroupStrategy
Source§fn eq(&self, other: &RowGroupStrategy) -> bool
fn eq(&self, other: &RowGroupStrategy) -> bool
Tests for
self and other values to be equal, and is used by ==.Source§impl Serialize for RowGroupStrategy
impl Serialize for RowGroupStrategy
impl Copy for RowGroupStrategy
impl Eq for RowGroupStrategy
impl StructuralPartialEq for RowGroupStrategy
Auto Trait Implementations§
impl Freeze for RowGroupStrategy
impl RefUnwindSafe for RowGroupStrategy
impl Send for RowGroupStrategy
impl Sync for RowGroupStrategy
impl Unpin for RowGroupStrategy
impl UnsafeUnpin for RowGroupStrategy
impl UnwindSafe for RowGroupStrategy
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.