Skip to main content

ColumnarStats

Struct ColumnarStats 

Source
pub struct ColumnarStats {
Show 14 fields pub columnar_hits: AtomicU64, pub columnar_misses: AtomicU64, pub columnar_typed_hits: AtomicU64, pub selection_attached: AtomicU64, pub selection_materialized: AtomicU64, pub selection_pushed: AtomicU64, pub column_block_hits: AtomicU64, pub multiplicity_expanded: AtomicU64, pub spill_rows: AtomicU64, pub spill_bytes: AtomicU64, pub spill_runs: AtomicU64, pub batch_outlets: AtomicU64, pub columnar_b_path_hits: AtomicU64, pub columnar_wasted_builds: AtomicU64, /* private fields */
}
Expand description

Query-level columnar fast-path counters (observability).

Shared via Arc with the chunks produced by source operators; every DataChunk::evaluate_expression call records a hit (columnar batch path succeeded) or a miss (fell back to per-row evaluation). The miss rate exposes how much of the flat-column promise is actually kept.

columnar_typed_hits additionally counts evaluations served by the typed batch fast path (raw Vec<i64>/Vec<f64>/Vec<i32> buffers). Selection-vector counters record how often chunks are handed downstream with a selection attached vs. materialized at a boundary.

Fields§

§columnar_hits: AtomicU64§columnar_misses: AtomicU64§columnar_typed_hits: AtomicU64

Evaluations served by the typed batch fast path.

§selection_attached: AtomicU64

Chunks handed downstream with a selection vector attached.

§selection_materialized: AtomicU64

Chunks materialized at a selection boundary.

§selection_pushed: AtomicU64

evaluations served by the selection-aware visible-row fast path (selection vector consumed without materializing).

§column_block_hits: AtomicU64

Chunks produced by a source via the storage column-block path (A1).

§multiplicity_expanded: AtomicU64

Logical rows produced by expanding DataChunk::multiplicity at opaque boundaries (normalize_for_opaque). Compared against stored rows it yields the expanded/stored ratio for PROFILE observability.

§spill_rows: AtomicU64

Rows written to spill runs (all operators, incl. terminal collector).

§spill_bytes: AtomicU64

Bytes written to spill runs (on-disk file sizes).

§spill_runs: AtomicU64

Number of spill runs finalized.

§batch_outlets: AtomicU64

Chunks emitted through the batch-slice outlet path.

§columnar_b_path_hits: AtomicU64

Expressions served by the typed columnar fast path on the compiled (project/filter) hot path — i.e. the compiled-over-rows path was bypassed because the chunk carried a usable typed layout. Distinct from columnar_typed_hits, which counts the scalar chunk evaluator.

§columnar_wasted_builds: AtomicU64

Typed layouts built by a producer that were dropped before any downstream consumer read them (take_rows_for_reuse, join build consumption). A high count means typed columns were built in vain.

Implementations§

Source§

impl ColumnarStats

Source

pub fn new() -> Self

Source

pub fn record_hit(&self)

Source

pub fn record_miss(&self)

Source

pub fn record_typed_hit(&self)

Record an evaluation served by the typed batch fast path.

Source

pub fn record_b_path_hit(&self)

Record an expression served by the typed columnar fast path on the compiled (project/filter) hot path.

Source

pub fn record_wasted_build(&self)

Record a typed layout dropped before any downstream consumer read it.

Source

pub fn record_selection_attached(&self)

Record a chunk handed downstream with a selection vector.

Source

pub fn record_selection_materialized(&self)

Record a chunk materialized at a selection boundary.

Source

pub fn record_selection_materialized_by(&self, op: &'static str)

Record a chunk materialized at a named operator boundary.

The hot path is lock-free: it bumps the global counter and, if op belongs to the closed SELECTION_BOUNDARY_OPS enumeration, the matching per-operator atomic slot. Unknown labels still count toward the global materialization total but are not attributed per operator.

Source

pub fn record_selection_pushed(&self)

record an evaluation served by the selection-aware visible-row fast path (selection consumed in place, upstream chunk untouched).

Source

pub fn materialized_by_operator(&self) -> HashMap<&'static str, u64>

materialization sites, attributed per operator.

Source

pub fn record_column_block_hit(&self)

Record a chunk produced via the storage column-block path (A1).

Source

pub fn record_multiplicity_expanded(&self, n: u64)

Record n logical rows produced by multiplicity expansion.

Source

pub fn record_spill(&self, rows: u64, bytes: u64)

Record one finalized spill run.

Source

pub fn record_batch_outlet(&self)

Record one chunk emitted through the batch-slice outlet path.

Source

pub fn record_spill_with_runs(&self, rows: u64, bytes: u64, runs: u64)

Record aggregated spill output covering runs finalized runs.

Terminal collector paths finalize N runs but report once; passing the run count keeps spill_runs exact instead of undercounting to 1.

Source

pub fn hit_rate(&self) -> f64

Fraction of evaluation calls that hit the columnar fast path. Returns 1.0 when nothing was evaluated (vacuous).

Source

pub fn typed_hit_rate(&self) -> f64

Fraction of evaluations served by the typed batch fast path.

Source

pub fn selection_passthrough_rate(&self) -> f64

Selection passthrough rate: attached / (attached + materialized). 1.0 means every selected chunk reached its consumer without materializing.

Trait Implementations§

Source§

impl Debug for ColumnarStats

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl Default for ColumnarStats

Source§

fn default() -> Self

Returns the “default value” for a type. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<T> Conv for T

Source§

fn conv<T>(self) -> T
where Self: Into<T>,

Converts self into T using Into<T>. Read more
Source§

impl<T> FmtForward for T

Source§

fn fmt_binary(self) -> FmtBinary<Self>
where Self: Binary,

Causes self to use its Binary implementation when Debug-formatted.
Source§

fn fmt_display(self) -> FmtDisplay<Self>
where Self: Display,

Causes self to use its Display implementation when Debug-formatted.
Source§

fn fmt_lower_exp(self) -> FmtLowerExp<Self>
where Self: LowerExp,

Causes self to use its LowerExp implementation when Debug-formatted.
Source§

fn fmt_lower_hex(self) -> FmtLowerHex<Self>
where Self: LowerHex,

Causes self to use its LowerHex implementation when Debug-formatted.
Source§

fn fmt_octal(self) -> FmtOctal<Self>
where Self: Octal,

Causes self to use its Octal implementation when Debug-formatted.
Source§

fn fmt_pointer(self) -> FmtPointer<Self>
where Self: Pointer,

Causes self to use its Pointer implementation when Debug-formatted.
Source§

fn fmt_upper_exp(self) -> FmtUpperExp<Self>
where Self: UpperExp,

Causes self to use its UpperExp implementation when Debug-formatted.
Source§

fn fmt_upper_hex(self) -> FmtUpperHex<Self>
where Self: UpperHex,

Causes self to use its UpperHex implementation when Debug-formatted.
Source§

fn fmt_list(self) -> FmtList<Self>
where &'a Self: for<'a> IntoIterator,

Formats each item in a sequence. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self> ⓘ

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self> ⓘ

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> IntoEither for T

Source§

fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ

Converts self into a Left variant of Either<Self, Self> if into_left is true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
where F: FnOnce(&Self) -> bool,

Converts self into a Left variant of Either<Self, Self> if into_left(&self) returns true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

impl<T> Pipe for T
where T: ?Sized,

Source§

fn pipe<R>(self, func: impl FnOnce(Self) -> R) -> R
where Self: Sized,

Pipes by value. This is generally the method you want to use. Read more
Source§

fn pipe_ref<'a, R>(&'a self, func: impl FnOnce(&'a Self) -> R) -> R
where R: 'a,

Borrows self and passes that borrow into the pipe function. Read more
Source§

fn pipe_ref_mut<'a, R>(&'a mut self, func: impl FnOnce(&'a mut Self) -> R) -> R
where R: 'a,

Mutably borrows self and passes that borrow into the pipe function. Read more
Source§

fn pipe_borrow<'a, B, R>(&'a self, func: impl FnOnce(&'a B) -> R) -> R
where Self: Borrow<B>, B: 'a + ?Sized, R: 'a,

Borrows self, then passes self.borrow() into the pipe function. Read more
Source§

fn pipe_borrow_mut<'a, B, R>( &'a mut self, func: impl FnOnce(&'a mut B) -> R, ) -> R
where Self: BorrowMut<B>, B: 'a + ?Sized, R: 'a,

Mutably borrows self, then passes self.borrow_mut() into the pipe function. Read more
Source§

fn pipe_as_ref<'a, U, R>(&'a self, func: impl FnOnce(&'a U) -> R) -> R
where Self: AsRef<U>, U: 'a + ?Sized, R: 'a,

Borrows self, then passes self.as_ref() into the pipe function.
Source§

fn pipe_as_mut<'a, U, R>(&'a mut self, func: impl FnOnce(&'a mut U) -> R) -> R
where Self: AsMut<U>, U: 'a + ?Sized, R: 'a,

Mutably borrows self, then passes self.as_mut() into the pipe function.
Source§

fn pipe_deref<'a, T, R>(&'a self, func: impl FnOnce(&'a T) -> R) -> R
where Self: Deref<Target = T>, T: 'a + ?Sized, R: 'a,

Borrows self, then passes self.deref() into the pipe function.
Source§

fn pipe_deref_mut<'a, T, R>( &'a mut self, func: impl FnOnce(&'a mut T) -> R, ) -> R
where Self: DerefMut<Target = T> + Deref, T: 'a + ?Sized, R: 'a,

Mutably borrows self, then passes self.deref_mut() into the pipe function.
Source§

impl<T> Pointable for T

Source§

const ALIGN: usize

The alignment of pointer.
Source§

type Init = T

The type for initializers.
Source§

unsafe fn init(init: <T as Pointable>::Init) -> usize

Initializes a with the given initializer. Read more
Source§

unsafe fn deref<'a>(ptr: usize) -> &'a T

Dereferences the given pointer. Read more
Source§

unsafe fn deref_mut<'a>(ptr: usize) -> &'a mut T

Mutably dereferences the given pointer. Read more
Source§

unsafe fn drop(ptr: usize)

Drops the object pointed to by the given pointer. Read more
Source§

impl<T> Read<Exclusive, BecauseExclusive> for T
where T: ?Sized,

Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T> Tap for T

Source§

fn tap(self, func: impl FnOnce(&Self)) -> Self

Immutable access to a value. Read more
Source§

fn tap_mut(self, func: impl FnOnce(&mut Self)) -> Self

Mutable access to a value. Read more
Source§

fn tap_borrow<B>(self, func: impl FnOnce(&B)) -> Self
where Self: Borrow<B>, B: ?Sized,

Immutable access to the Borrow<B> of a value. Read more
Source§

fn tap_borrow_mut<B>(self, func: impl FnOnce(&mut B)) -> Self
where Self: BorrowMut<B>, B: ?Sized,

Mutable access to the BorrowMut<B> of a value. Read more
Source§

fn tap_ref<R>(self, func: impl FnOnce(&R)) -> Self
where Self: AsRef<R>, R: ?Sized,

Immutable access to the AsRef<R> view of a value. Read more
Source§

fn tap_ref_mut<R>(self, func: impl FnOnce(&mut R)) -> Self
where Self: AsMut<R>, R: ?Sized,

Mutable access to the AsMut<R> view of a value. Read more
Source§

fn tap_deref<T>(self, func: impl FnOnce(&T)) -> Self
where Self: Deref<Target = T>, T: ?Sized,

Immutable access to the Deref::Target of a value. Read more
Source§

fn tap_deref_mut<T>(self, func: impl FnOnce(&mut T)) -> Self
where Self: DerefMut<Target = T> + Deref, T: ?Sized,

Mutable access to the Deref::Target of a value. Read more
Source§

fn tap_dbg(self, func: impl FnOnce(&Self)) -> Self

Calls .tap() only in debug builds, and is erased in release builds.
Source§

fn tap_mut_dbg(self, func: impl FnOnce(&mut Self)) -> Self

Calls .tap_mut() only in debug builds, and is erased in release builds.
Source§

fn tap_borrow_dbg<B>(self, func: impl FnOnce(&B)) -> Self
where Self: Borrow<B>, B: ?Sized,

Calls .tap_borrow() only in debug builds, and is erased in release builds.
Source§

fn tap_borrow_mut_dbg<B>(self, func: impl FnOnce(&mut B)) -> Self
where Self: BorrowMut<B>, B: ?Sized,

Calls .tap_borrow_mut() only in debug builds, and is erased in release builds.
Source§

fn tap_ref_dbg<R>(self, func: impl FnOnce(&R)) -> Self
where Self: AsRef<R>, R: ?Sized,

Calls .tap_ref() only in debug builds, and is erased in release builds.
Source§

fn tap_ref_mut_dbg<R>(self, func: impl FnOnce(&mut R)) -> Self
where Self: AsMut<R>, R: ?Sized,

Calls .tap_ref_mut() only in debug builds, and is erased in release builds.
Source§

fn tap_deref_dbg<T>(self, func: impl FnOnce(&T)) -> Self
where Self: Deref<Target = T>, T: ?Sized,

Calls .tap_deref() only in debug builds, and is erased in release builds.
Source§

fn tap_deref_mut_dbg<T>(self, func: impl FnOnce(&mut T)) -> Self
where Self: DerefMut<Target = T> + Deref, T: ?Sized,

Calls .tap_deref_mut() only in debug builds, and is erased in release builds.
Source§

impl<T> TryConv for T

Source§

fn try_conv<T>(self) -> Result<T, Self::Error>
where Self: TryInto<T>,

Attempts to convert self into T using TryInto<T>. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = !

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, !>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

Source§

fn vzip(self) -> V

Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self> ⓘ
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self> ⓘ

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more