Struct RuntimeStats 

#[non_exhaustive]
pub struct RuntimeStats {
    pub input_rows: u64,
    pub output_rows: u64,
    pub cpu_nanos: u64,
    pub memory_bytes: u64,
    pub spill_bytes: u64,
    pub serialized_bytes: u64,
}

Runtime statistics collected by an executor stage.

These are fed back into AQE rules so the optimizer can re-plan in-flight.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

input_rows: u64

Number of input rows processed.

output_rows: u64

Number of output rows produced.

cpu_nanos: u64

Actual CPU time consumed in nanoseconds.

memory_bytes: u64

Peak memory used in bytes.

spill_bytes: u64

Bytes spilled to disk.

serialized_bytes: u64

Actual bytes written to the shuffle store (Arrow IPC / Parquet on disk).

When non-zero, AQE rules prefer this over memory_bytes for partition sizing, because shuffle output is compressed/serialized and therefore a more accurate proxy for network and disk cost. memory_bytes is the peak in-memory footprint, which can be 2–4× larger than the wire size. Zero means the value was not collected (older task builds or non-shuffle tasks), and the rule falls back to memory_bytes.

Trait Implementations

impl Clone for RuntimeStats

fn clone(&self) -> RuntimeStats

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for RuntimeStats

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for RuntimeStats

fn default() -> RuntimeStats

Returns the “default value” for a type.

impl Eq for RuntimeStats

impl PartialEq for RuntimeStats

fn eq(&self, other: &RuntimeStats) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for RuntimeStats