Expand description
The placement table: which node serves infer.<role> right now.
Local instances come from the card-18 adapter (InferRuntime:
reconcile, health, endpoint); remote ones from infer.<role>
ServiceAdvertisements of admitted peers. Resolution prefers the
local instance (sticky: warm KV), then the first admitted peer in node-id
order. Every change bumps a generation so caches (the ProviderRouter
TTL cache) can be invalidated.
Structs§
- Mesh
Local - A local instance a peer’s request may reach.
- Placement
Table - Role to serving node.
- Sync
Outcome - What
PlacementTable::sync_localfound.
Constants§
- DEFAULT_
ADVERT_ TTL - How long a received advertisement counts without being refreshed.
- SERVICE_
PREFIX - Prefix of the advertised service name.