Expand description
Shared KV cache trace logging for both vLLM and SGLang backends.
Enabled by setting DYN_MOCKER_KV_CACHE_TRACE=1 or true.
Structs§
- Sglang
Cache State - SGLang cache state snapshot for trace logging.
Statics§
- KV_
CACHE_ TRACE_ ENABLED - Check the env var to enable KV cache allocation/eviction trace logs.
Functions§
- log_
sglang_ trace - Log an SGLang KV cache trace event.
- log_
vllm_ trace - Log a vLLM KV cache trace event.