Skip to main content

Module kv_cache_trace

Module kv_cache_trace 

Source
Expand description

Shared KV cache trace logging for both vLLM and SGLang backends.

Enabled by setting DYN_MOCKER_KV_CACHE_TRACE=1 or true.

Structs§

SglangCacheState
SGLang cache state snapshot for trace logging.

Statics§

KV_CACHE_TRACE_ENABLED
Check the env var to enable KV cache allocation/eviction trace logs.

Functions§

log_sglang_trace
Log an SGLang KV cache trace event.
log_vllm_trace
Log a vLLM KV cache trace event.