Struct DenseStreamTelemetry 

pub struct DenseStreamTelemetry { /* private fields */ }

Backend-neutral lifecycle and aggregation state for dense-stream telemetry.

Implementations

impl DenseStreamTelemetry

pub fn new( planned_layer_count: usize, planned_layer_bytes: u64, maximum_host_layer_bytes: u64, pinned_static_device_bytes: u64, transfer_stream_index: i32, groups: impl IntoIterator<Item = (String, Vec<OffloadUnitId>)>, ) -> Self

Creates telemetry state for a fixed execution-group and residency plan.

pub fn begin_forward( &self, prefill: bool, offload: &OffloadReport, ) -> Result<(), DenseStreamTelemetryError>

Starts attribution for one prefill or decode pass.

pub fn observe_group( &self, group: &str, prefill: bool, units: &[UnitResidencyReport], ) -> Result<(), DenseStreamTelemetryError>

Records current group and whole-plan occupancy during an active pass.

pub fn record_group_execution( &self, group: &str, ) -> Result<(), DenseStreamTelemetryError>

Records successful completion of one named execution group.

pub fn commit_forward( &self, offload: &OffloadReport, ) -> Result<(), DenseStreamTelemetryError>

Commits counter deltas and occupancy peaks for the active pass.

pub fn abort_forward(&self)

Aborts the active pass without committing partial counter deltas.

pub fn report( &self, residency: ResidencyReport, background: BackgroundPrefetchReport, ) -> Result<DenseDiskStreamReport, DenseStreamTelemetryError>

Builds a stable report from a coherent residency and worker snapshot.

Trait Implementations

impl Debug for DenseStreamTelemetry

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.