Skip to main content

Module dense

Module dense 

Source
Expand description

Backend-neutral dense-stream residency telemetry. Backend-neutral dense-stream residency telemetry.

Structs§

DenseCacheMetrics
Cache activity attributed to one logical residency tier.
DenseDiskStreamReport
Stable dense-stream observations combining residency and worker state.
DenseExecutionGroupReport
Point-in-time occupancy for one named execution stack.
DensePassCounterSnapshot
Counter snapshot used to attribute residency activity to one forward pass.
DensePassReport
Cache and logical transfer activity from completed prefill or decode forwards.
DenseStreamTelemetry
Backend-neutral lifecycle and aggregation state for dense-stream telemetry.
DenseTierResidencyReport
Streamed-layer occupancy and cache history for one tier.

Enums§

DenseStreamTelemetryError
Invalid dense-stream telemetry lifecycle or execution-group access.