Skip to main content

Crate modelexpress_server

Crate modelexpress_server 

Source

Re-exports§

pub use cache::*;
pub use config::*;
pub use services::*;

Modules§

backend_config
Shared backend selection for distributed stores (Redis and Kubernetes CRDs).
cache
config
p2p
P2P model metadata: worker coordination, tensor descriptors, and NIXL RDMA transfer.
registry
Distributed model registry: model-download lifecycle (DOWNLOADING / DOWNLOADED / ERROR) and LRU cache-eviction timestamps.
services