modelexpress-server 0.4.0

High-performance gRPC server for model serving and management
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15

// SPDX-FileCopyrightText: Copyright (c) 2025-2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
// SPDX-License-Identifier: Apache-2.0

//! P2P model metadata: worker coordination, tensor descriptors, and NIXL RDMA transfer.
//!
//! The backend abstraction (`backend`) persists worker metadata to Redis or Kubernetes CRDs;
//! `state` wraps it with a lazy-connect manager; `service` exposes the gRPC surface; `reaper`
//! garbage-collects stale workers; `source_identity` derives deterministic source IDs.

pub mod backend;
pub mod k8s_types;
pub mod reaper;
pub mod service;
pub mod source_identity;
pub mod state;