dynamo-kv-router 1.3.0

KV Router - Radix tree for LLM KV cache routing
Documentation
1
2
3
4
5
6
7
8
9
10
11
# lib/kv-router/src/services

These services must not depend on `dynamo-runtime`.

## Guardrails

- Do not assume a Dynamo request plane, discovery plane, or event plane exists.
- Do not add direct or optional `dynamo-runtime` dependencies to service code.
- Prefer brokerless transport primitives such as TCP, HTTP, and ZMQ.
- Keep service protocols usable by processes that do not run any other Dynamo components.
- Keep reusable routing, indexing, and tracking logic outside this directory.