Enum KvOffload 

pub enum KvOffload {
    None,
    Nixl,
    Lmcache,
    Hicache,
    Kvbm,
}

Engine-side KV connector / offload backend.

Selects which --kv-transfer-config (vLLM) or hierarchical-cache flag set (SGLang) the agent injects when spawning the engine. The router is unaware of this dial — it only sees prefix-overlap signals via cgn-kvcached either way.

Compatibility:

Engine	none	nixl	lmcache	hicache	kvbm
vllm	yes	yes	yes	no	yes
sglang	yes	yes	no	yes	no
llama_cpp	yes	no	no	no	no
openai_compat	yes	no	no	no	no

In disaggregated topologies ([agent].role = "prefill" or "decode") the renderer automatically composes the offload backend with NIXL so blocks produced on the prefill GPU stream to the decode GPU. See cgn-agent::engine::spawn for the full table.

Variants

None

No engine-side connector. Default. Use this for dev loops or when KV state is purely engine-internal.

Nixl

NIXL only — sufficient for prefill→decode handoff in disagg without any extra offload backend.

Lmcache

LMCache (LMCacheConnectorV1). Adds CPU/SSD/Redis/Mooncake KV reuse on top of vLLM. In disagg, automatically wraps with a PdConnector(LMCache + NIXL) MultiConnector.

Hicache

SGLang Hierarchical Cache (--enable-hierarchical-cache). SGLang-only. Stacks on top of RadixAttention.

Kvbm

NVIDIA Dynamo KVBM (DynamoConnector from kvbm.vllm_integration.connector). Requires the kvbm Python package on the engine host.

Implementations

impl KvOffload

pub fn as_str(self) -> &'static str

Lower-case canonical name (matches the TOML serialization).

Trait Implementations

impl Clone for KvOffload

fn clone(&self) -> KvOffload

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for KvOffload

impl Debug for KvOffload

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for KvOffload

fn default() -> KvOffload

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for KvOffload

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Eq for KvOffload

impl PartialEq for KvOffload

fn eq(&self, other: &KvOffload) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for KvOffload

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for KvOffload