Struct ChunkBatcherConfig 

pub struct ChunkBatcherConfig {
    pub flush_tick: Duration,
    pub flush_num_bytes: u64,
    pub flush_num_rows: u64,
    pub chunk_max_rows_if_unsorted: u64,
    pub max_commands_in_flight: Option<u64>,
    pub max_chunks_in_flight: Option<u64>,
}

Defines the different thresholds of the associated ChunkBatcher.

See Self::default and Self::from_env.

Fields

flush_tick: Duration

Duration of the periodic tick.

flush_num_bytes: u64

Flush if the accumulated payload has a size in bytes equal or greater than this.

The resulting Chunk might be larger than flush_num_bytes!

flush_num_rows: u64

Flush if the accumulated payload has a number of rows equal or greater than this.

chunk_max_rows_if_unsorted: u64

Split a chunk if it contains >= rows than this threshold and one or more of its timelines are unsorted.

max_commands_in_flight: Option<u64>

Size of the internal channel of commands.

Unbounded if left unspecified. Once a batcher is created, this property cannot be changed.

max_chunks_in_flight: Option<u64>

Size of the internal channel of Chunks.

Unbounded if left unspecified. Once a batcher is created, this property cannot be changed.

Implementations

impl ChunkBatcherConfig

pub const DEFAULT: Self

Default configuration, applicable to most use cases.

pub const LOW_LATENCY: Self

Low-latency configuration, preferred when streaming directly to a viewer.

pub const ALWAYS: Self

Always flushes ASAP.

pub const NEVER: Self

Never flushes unless manually told to (or hitting one the builtin invariants).

pub const ENV_FLUSH_TICK: &'static str = "RERUN_FLUSH_TICK_SECS"

Environment variable to configure Self::flush_tick.

pub const ENV_FLUSH_NUM_BYTES: &'static str = "RERUN_FLUSH_NUM_BYTES"

Environment variable to configure Self::flush_num_bytes.

pub const ENV_FLUSH_NUM_ROWS: &'static str = "RERUN_FLUSH_NUM_ROWS"

Environment variable to configure Self::flush_num_rows.

pub const ENV_CHUNK_MAX_ROWS_IF_UNSORTED: &'static str = "RERUN_CHUNK_MAX_ROWS_IF_UNSORTED"

Environment variable to configure Self::chunk_max_rows_if_unsorted.

pub fn from_env() -> ChunkBatcherResult<Self>

Creates a new ChunkBatcherConfig using the default values, optionally overridden through the environment.

See Self::apply_env.

pub fn apply_env(&self) -> ChunkBatcherResult<Self>

Returns a copy of self, overriding existing fields with values from the environment if they are present.

See Self::ENV_FLUSH_TICK, Self::ENV_FLUSH_NUM_BYTES, Self::ENV_FLUSH_NUM_BYTES.

Trait Implementations

impl Clone for ChunkBatcherConfig

fn clone(&self) -> ChunkBatcherConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ChunkBatcherConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ChunkBatcherConfig

fn default() -> Self

Returns the “default value” for a type.

impl PartialEq for ChunkBatcherConfig

fn eq(&self, other: &ChunkBatcherConfig) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for ChunkBatcherConfig

impl StructuralPartialEq for ChunkBatcherConfig