Struct Metrics 

pub struct Metrics {
    pub dp_rank: u32,
    pub active_blocks: u64,
    pub total_blocks: u64,
    pub cache_usage: f64,
    pub running_requests: u64,
    pub waiting_requests: u64,
    pub preemptions_total: u64,
    pub sglang_cache_hit_tokens: u64,
    pub sglang_cache_total_tokens: u64,
}

Rank-local scheduler and G1 metrics.

Fields

dp_rank: u32

active_blocks: u64

total_blocks: u64

cache_usage: f64

running_requests: u64

waiting_requests: u64

preemptions_total: u64

sglang_cache_hit_tokens: u64

SGLang radix-cache tokens reused by the most recently completed pass.

Backends without an equivalent pass-local metric report zero.

sglang_cache_total_tokens: u64

Total SGLang prefill tokens considered by the most recently completed pass. Backends without an equivalent pass-local metric report zero.

Trait Implementations

impl Clone for Metrics

fn clone(&self) -> Metrics

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Metrics

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for Metrics

fn default() -> Metrics

Returns the “default value” for a type.

impl PartialEq for Metrics

fn eq(&self, other: &Metrics) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for Metrics